Cloud disasters: Musey deletes their own company!
In this episode, we uncover the little-known but cautionary tale of Musey, a startup building an interior design app that catastrophically lost everything when an admin accidentally deleted their entire Google Workspace account.
We dive deep into:
- How a single slip-up by an admin led to over $1.5 million of intellectual property stored in Google Drive getting instantly wiped out
- Musey's desperate attempts to get their data back by contacting Google and even filing a lawsuit
- How not even the cloud giants like Google have an obligation to restore customer data lost due to error or malfeasance
- Why you absolutley need independent backups of cloud data instead of blindly trusting sync and retention policies
The devastating story of Musey serves as a sobering reminder that human error can still trump even the most resilient cloud platforms. Don’t miss this rare peek behind the curtain at a colossal cloud failure that very few people know about.
00:00 - Musey
24:29 -
Speaker:
Several years ago, a small startup placed all their eggs in the Google
Speaker:
drive basket, and then proceeded to set that basket on fire.
Speaker:
With one fatal click by an admin over a million dollars.
Speaker:
Went up in smoke.
Speaker:
Today we investigate the tragic tale of Musey, a promising young
Speaker:
company building an innovative app who lost everything when their Google
Speaker:
account was wiped out instantly.
Speaker:
This is our second in a series called cloud disasters.
Speaker:
Organizations that thought their data in the cloud was protected.
Speaker:
Only to find out it wasn't, it was too late for them, but not for you.
Speaker:
Hi, I'm w Curtis Preston, AKA Mr.
Speaker:
Backup.
Speaker:
And my goal with this podcast is to make sure that something
Speaker:
like that never happens to you.
Speaker:
This is the backup wrap up.
Speaker:
W. Curtis Preston: Welcome to the show.
Speaker:
I'm your host, w Curtis Preston, and I have with me Persona Ana.
Speaker:
I'm doing well, Curtis.
Speaker:
We're talking about this concept of.
Speaker:
Things that people think don't need to be backed up.
Speaker:
And they definitely need to be backed up.
Speaker:
And we're zooming in and doing a, a deep dive into each of the
Speaker:
stories that we often talk about when we reference this, right?
Speaker:
So these are, uh, typically cloud systems, you know, cloud services that people
Speaker:
thought that were backed up and then.
Speaker:
Uh, when they accidentally screwed something up, they
Speaker:
found out they weren't
Prasanna Malaiyandi:
They were relying on it for their business and for their
Prasanna Malaiyandi:
livelihood and bad things happen.
Prasanna Malaiyandi:
W. Curtis Preston: And sometimes, many times those things are like attacks.
Prasanna Malaiyandi:
Uh, you know, you know, things like that.
Prasanna Malaiyandi:
In this case though, this, uh, one is, you know, it's a reminder that.
Prasanna Malaiyandi:
We spent a lot of time on the podcast, talking especially lately
Prasanna Malaiyandi:
about cyber attacks and things like that and ransomware, and
Prasanna Malaiyandi:
we don't talk that much about equipment failure because typically, uh, you
Prasanna Malaiyandi:
know, thanks to the advent of raid and erasure coding and things like that.
Prasanna Malaiyandi:
Generally, that's not the reason people restore data.
Prasanna Malaiyandi:
The interesting thing about this story, it that I, one interesting thing that
Prasanna Malaiyandi:
I found out, or that I noticed was that it was only covered by the register.
Prasanna Malaiyandi:
So, uh, thanks to the folks over there.
Prasanna Malaiyandi:
I, I don't even know.
Prasanna Malaiyandi:
How they, uh, you know, found it, somebody sent it to them
Prasanna Malaiyandi:
and then nobody else covered it.
Prasanna Malaiyandi:
Which is interesting 'cause I looked around, I couldn't
Prasanna Malaiyandi:
find any coverage of it.
Prasanna Malaiyandi:
So this is about a company called Musi, which also I found
Prasanna Malaiyandi:
out, goes by the name of Moss, M-O-S-S-S.
Prasanna Malaiyandi:
They do have a Facebook page.
Prasanna Malaiyandi:
That you can find.
Prasanna Malaiyandi:
But They were a company that was building an interior design app that would be
Prasanna Malaiyandi:
used by influencers, home decorators and other folks to sort of showcase
Prasanna Malaiyandi:
what you see on the inside of a house.
Prasanna Malaiyandi:
And, um, basically somehow someone went and deleted their entire G
Prasanna Malaiyandi:
Suite account for the entire company.
Prasanna Malaiyandi:
Which contained all of their data.
Prasanna Malaiyandi:
And from what I could tell, they weren't doing backups.
Prasanna Malaiyandi:
And that's kind of where things start now.
Prasanna Malaiyandi:
They try to get the data back, and I think we'll talk about that in a
Prasanna Malaiyandi:
little bit about what they did to try to get their data back from Google.
Prasanna Malaiyandi:
But yeah, like Curtis says, it's not a happy ending.
Prasanna Malaiyandi:
W. Curtis Preston: Yeah.
Prasanna Malaiyandi:
It appears that it was their admin, right?
Prasanna Malaiyandi:
The idea that I remember hearing was that they were trying to delete a test account.
Prasanna Malaiyandi:
I.
Prasanna Malaiyandi:
But instead of deleting a test account, they deleted the production account.
Prasanna Malaiyandi:
And we need to be very specific here.
Prasanna Malaiyandi:
They didn't delete a user, right?
Prasanna Malaiyandi:
You know, in, in Google Drive or Google Workspace, you could have
Prasanna Malaiyandi:
users underneath your account.
Prasanna Malaiyandi:
They deleted The entire account
Prasanna Malaiyandi:
The organization's account.
Prasanna Malaiyandi:
W. Curtis Preston: Yeah.
Prasanna Malaiyandi:
The, yeah, the, the entire organization, right.
Prasanna Malaiyandi:
According to their court filing.
Prasanna Malaiyandi:
They did immediately contact Google and say, Hey, this thing happened.
Prasanna Malaiyandi:
And I'm gonna say, sadly, the Google, uh, support rep said,
Prasanna Malaiyandi:
I'll get right on it, rather than
Prasanna Malaiyandi:
saying, yeah, you're screwed.
Prasanna Malaiyandi:
Not my problem.
Prasanna Malaiyandi:
W. Curtis Preston: yeah, not my problem.
Prasanna Malaiyandi:
Yeah, you're screwed.
Prasanna Malaiyandi:
You should have backed that up.
Prasanna Malaiyandi:
Uh, where's your backups?
Prasanna Malaiyandi:
Uh, what the, uh, the Google person allegedly said was, we'll get right on it.
Prasanna Malaiyandi:
Meanwhile, they're out there desperately trying to reach someone at Google for
Prasanna Malaiyandi:
multiple days, even multiple weeks.
Prasanna Malaiyandi:
Meanwhile, they're not able to contact, their customers are not able to, you know,
Prasanna Malaiyandi:
access any of their intellectual property.
Prasanna Malaiyandi:
So apparently they had built.
Prasanna Malaiyandi:
This entire app, uh, and everything was stored in G Drive and apparently they
Prasanna Malaiyandi:
weren't, uh, you know, I'm just saying based on what happened, it does not
Prasanna Malaiyandi:
appear that they were synchronizing.
Prasanna Malaiyandi:
'cause you could synchronize, uh, Google Drive down to your, uh, you know, desktop.
Prasanna Malaiyandi:
And if they had deleted the account up there, the desktop copy
Prasanna Malaiyandi:
probably would have, uh, remained.
Prasanna Malaiyandi:
But they didn't do that because once they had deleted the, um, you know, this.
Prasanna Malaiyandi:
The, the cloud version of it, they had nothing.
Prasanna Malaiyandi:
Right?
Prasanna Malaiyandi:
So they had nothing in their, of their intellectual property that they
Prasanna Malaiyandi:
had built, uh, that they had spent a million and a half dollars on, right?
Prasanna Malaiyandi:
That, that was in, in the court filings, that they had spent a million and a
Prasanna Malaiyandi:
half dollars on this company so far.
Prasanna Malaiyandi:
And they also mentioned that they weren't able to contact their customers,
Prasanna Malaiyandi:
they weren't able to do business.
Prasanna Malaiyandi:
And there is, uh, they said a few weeks later.
Prasanna Malaiyandi:
I feel like saying
Prasanna Malaiyandi:
a few moments later.
Prasanna Malaiyandi:
I now have that in your head, don't I?
Prasanna Malaiyandi:
W. Curtis Preston: it's your fault.
Prasanna Malaiyandi:
Um, go Google did get back to them and say, uh, they can't get their data back.
Prasanna Malaiyandi:
I think the weirdest part of the story that you might want to talk about is this.
Prasanna Malaiyandi:
They're saying that
Prasanna Malaiyandi:
someone at Google, and I don't see any evidence of this, but they're
Prasanna Malaiyandi:
saying, someone at Google said something along the lines of, maybe you
Prasanna Malaiyandi:
could get the data back with a court
Prasanna Malaiyandi:
filing.
Prasanna Malaiyandi:
Did you see
Prasanna Malaiyandi:
anything about that?
Prasanna Malaiyandi:
I didn't see anything in the articles about
Prasanna Malaiyandi:
that, but that's just weird.
Prasanna Malaiyandi:
the Only time I could see that happening is potentially if they
Prasanna Malaiyandi:
had kept some of that data because of legal hold or some legal reason.
Prasanna Malaiyandi:
W. Curtis Preston: Yeah.
Prasanna Malaiyandi:
Or if for some reason they had a copy somewhere else,
Prasanna Malaiyandi:
like I could imagine in the case of doing like a disaster recovery copy,
Prasanna Malaiyandi:
maybe they had that copy somewhere else and you can get the data back.
Prasanna Malaiyandi:
Right.
Prasanna Malaiyandi:
It's not their obligation.
Prasanna Malaiyandi:
It's like a best effort.
Prasanna Malaiyandi:
I.
Prasanna Malaiyandi:
W. Curtis Preston: Right.
Prasanna Malaiyandi:
I agree with both scenarios.
Prasanna Malaiyandi:
I like that first one.
Prasanna Malaiyandi:
The second one, you know, we talk a lot about how many of these service
Prasanna Malaiyandi:
providers, they do have a backup, as I met quotes in the air of like the
Prasanna Malaiyandi:
entire data center that they can use.
Prasanna Malaiyandi:
To bring the data center back if they screw it up.
Prasanna Malaiyandi:
Right.
Prasanna Malaiyandi:
Um, but the, it's not built for you.
Prasanna Malaiyandi:
I give an example of Microsoft 365 says that they have a delayed copy of
Prasanna Malaiyandi:
exchange, uh, that can be used if they screw up the entire exchange environment.
Prasanna Malaiyandi:
But when I asked them directly as a Microsoft 365 customer,
Prasanna Malaiyandi:
can I use that delayed copy of exchange to restore my environment?
Prasanna Malaiyandi:
And they just said, no.
Prasanna Malaiyandi:
Right.
Prasanna Malaiyandi:
So maybe that's a scenario where somebody might have been alluding to it.
Prasanna Malaiyandi:
I don't know if that person was, uh, you know, um,
Prasanna Malaiyandi:
and,
Prasanna Malaiyandi:
W. Curtis Preston: talking outta school.
Prasanna Malaiyandi:
Right.
Prasanna Malaiyandi:
Um.
Prasanna Malaiyandi:
and also just along that, like if they were a billion dollar
Prasanna Malaiyandi:
company, I'm sure that it would've been a different result or Google may have
Prasanna Malaiyandi:
been more willing to jump in and help versus a smaller company like this.
Prasanna Malaiyandi:
W. Curtis Preston: yeah,
Prasanna Malaiyandi:
I'm not sure if the result would've been different.
Prasanna Malaiyandi:
I think maybe the activities along the way would've been the same.
Prasanna Malaiyandi:
Um, but the, the, the re by the way, the, where we get this, uh, this
Prasanna Malaiyandi:
comment about the subpoena or civil request was that was in their lawsuit.
Prasanna Malaiyandi:
And, and I have to say, I feel for these guys, uh, of what happened to them.
Prasanna Malaiyandi:
Because when I look at the filing, like you really have to see it to, like, you
Prasanna Malaiyandi:
have to literally lay your eyes on and we'll put a link to it in the show notes.
Prasanna Malaiyandi:
And what you see is a good portion of it is typed up and sort of like normal.
Prasanna Malaiyandi:
And then there's all these like handwritten notes all over it.
Prasanna Malaiyandi:
Like at the very beginning there's this like star.
Prasanna Malaiyandi:
And it says, serving a civil request to have access to our data
Prasanna Malaiyandi:
restored or provided as outlined a document for serving civil subpoenas
Prasanna Malaiyandi:
and civil requests given to us.
Prasanna Malaiyandi:
Emailed it says by Google.
Prasanna Malaiyandi:
Um, IE Google sent us instructions to get our data back.
Prasanna Malaiyandi:
Um, you know, and then.
Prasanna Malaiyandi:
They just sort of lay out this story in this lawsuit, which they say in the
Prasanna Malaiyandi:
lawsuit, we're not suing to get money.
Prasanna Malaiyandi:
We're suing to get our data back.
Prasanna Malaiyandi:
They basically believed that Google had a copy of their data and Google, you know,
Prasanna Malaiyandi:
clearly did not have a copy of their data.
Prasanna Malaiyandi:
Yeah, and just looking at the filing, I
Prasanna Malaiyandi:
don't think a lawyer wrote that,
Prasanna Malaiyandi:
W. Curtis Preston: No.
Prasanna Malaiyandi:
Oh yeah.
Prasanna Malaiyandi:
Thanks for bringing that up.
Prasanna Malaiyandi:
It is actually listed as a per se lawsuit,
Prasanna Malaiyandi:
which means that they filed
Prasanna Malaiyandi:
it themselves.
Prasanna Malaiyandi:
Yeah.
Prasanna Malaiyandi:
And just like, yeah, with the handwriting and everything else, you could tell
Prasanna Malaiyandi:
that it was an individual who was not an attorney writing and typing.
Prasanna Malaiyandi:
And I know that would, like you mentioned Curtis, they wanted their data back and
Prasanna Malaiyandi:
they were mentioning sort of what type of data they had stored in Google Drive.
Prasanna Malaiyandi:
Right?
Prasanna Malaiyandi:
It was, uh, their ip, ui, ux, mockups, user research.
Prasanna Malaiyandi:
And a whole bunch of other things, algorithm decisions, how they built it.
Prasanna Malaiyandi:
But the other thing is they were like, yeah, in our emails, we also had medical
Prasanna Malaiyandi:
records about someone's nephew who was going undergoing some treatment
Prasanna Malaiyandi:
and they needed access to their emails
Prasanna Malaiyandi:
W. Curtis Preston: Right.
Prasanna Malaiyandi:
That was the weirdest part, I think was just reading that they had intermixed.
Prasanna Malaiyandi:
I, you know what?
Prasanna Malaiyandi:
I don't know.
Prasanna Malaiyandi:
That just made no, that part made no sense to me.
Prasanna Malaiyandi:
Like it's not like they stored, it's not like this was the only copy of their.
Prasanna Malaiyandi:
Their nephew's medical records, like it was their only copy of
Prasanna Malaiyandi:
the nephew's medical records.
Prasanna Malaiyandi:
I, I thought that was very odd.
Prasanna Malaiyandi:
But the thing in the filing is that this was a filing in the federal.
Prasanna Malaiyandi:
US District Court for the Northern District of California, by the way, this
Prasanna Malaiyandi:
was in, um, the Bay Area and they, um, and so you have to give reason why the
Prasanna Malaiyandi:
federal court would be the jurisdiction, and they listed multiple reasons for that.
Prasanna Malaiyandi:
Um, but.
Prasanna Malaiyandi:
What we do know from the dockets, I was able to find that the lawsuit
Prasanna Malaiyandi:
was withdrawn, basically just
Prasanna Malaiyandi:
under two weeks later,
Prasanna Malaiyandi:
yeah.
Prasanna Malaiyandi:
That's suspicious.
Prasanna Malaiyandi:
Yeah.
Prasanna Malaiyandi:
Well, I think one thing we should also mention is this
Prasanna Malaiyandi:
happened in what year, Curtis?
Prasanna Malaiyandi:
W. Curtis Preston: uh, 2019.
Prasanna Malaiyandi:
Okay.
Prasanna Malaiyandi:
Yeah, so this was a while ago.
Prasanna Malaiyandi:
The interesting thing, and this is all just this is all just,
Prasanna Malaiyandi:
W. Curtis Preston: Yeah, we're hypothesizing, but I did my best to
Prasanna Malaiyandi:
try to find out, uh, everything I could, but this is our best effort
Prasanna Malaiyandi:
to, to figure out what happened.
Prasanna Malaiyandi:
yeah.
Prasanna Malaiyandi:
And I think what, like just given the timeframes, and it was two weeks
Prasanna Malaiyandi:
later after it was filed, either they.
Prasanna Malaiyandi:
Decided, or they maybe got legal counsel and talked to someone, they
Prasanna Malaiyandi:
were like, yeah, you're screwed.
Prasanna Malaiyandi:
Based on Google's response.
Prasanna Malaiyandi:
Or Google might have come after them and been like, Hey, if you really
Prasanna Malaiyandi:
wanna go through this, you're going to fail and then you're gonna have to
Prasanna Malaiyandi:
pay all our court fees, attorney fees,
Prasanna Malaiyandi:
W. Curtis Preston: Right,
Prasanna Malaiyandi:
in which case that would be like, I could, I can't even
Prasanna Malaiyandi:
imagine a Google attorney and how much that would cost because it would be
Prasanna Malaiyandi:
external counsel and everything else.
Prasanna Malaiyandi:
So they probably were like, yeah, it's not worth it.
Prasanna Malaiyandi:
Or maybe they talked to someone on Google who said, look.
Prasanna Malaiyandi:
We understand this is tough luck, but this is what it is.
Prasanna Malaiyandi:
And so maybe they had some sense knocked into them and they were like, yeah, this
Prasanna Malaiyandi:
doesn't make sense to move forward with.
Prasanna Malaiyandi:
It sucks, I feel for them, but there isn't much that Google
Prasanna Malaiyandi:
could really do at that point.
Prasanna Malaiyandi:
W. Curtis Preston: Yeah.
Prasanna Malaiyandi:
What was another sort of interesting thing about the story?
Prasanna Malaiyandi:
I, I just, I'm not sure why the dates don't line up.
Prasanna Malaiyandi:
In the filing, uh, the, the lawsuit filing, they said that the deletion
Prasanna Malaiyandi:
happened on June 8th, 2019.
Prasanna Malaiyandi:
The domain went up for sale on June 6th, 2019.
Prasanna Malaiyandi:
Mm.
Prasanna Malaiyandi:
W. Curtis Preston: The reason why I say that is, uh, the internet
Prasanna Malaiyandi:
archive found that right, the, the latest update for the website.
Prasanna Malaiyandi:
Uh, from June from 2019 was that it went, for se it said, domain available
Prasanna Malaiyandi:
for purchase, uh, June 6th, 2019, which would suggest that the deletion
Prasanna Malaiyandi:
happened on June 5th or June 6th.
Prasanna Malaiyandi:
But, um, I, I
Prasanna Malaiyandi:
thought that was to a little bit strange.
Prasanna Malaiyandi:
I don't mean to throw shade at the company, but it could also
Prasanna Malaiyandi:
be possible that the company just realized it's not feasible, what they're trying
Prasanna Malaiyandi:
to do in the timeframes they're given and ran outta cash and we're like, yeah.
Prasanna Malaiyandi:
, the one interesting thing is the fact that they're completely gone from the web.
Prasanna Malaiyandi:
Right.
Prasanna Malaiyandi:
There's no trace of 'em on the internet anywhere.
Prasanna Malaiyandi:
Right.
Prasanna Malaiyandi:
It's just really weird.
Prasanna Malaiyandi:
Like you can always find traces of a company that's gone bust somewhere.
Prasanna Malaiyandi:
W. Curtis Preston: Right.
Prasanna Malaiyandi:
yeah.
Prasanna Malaiyandi:
like you mentioned, the Register is the
Prasanna Malaiyandi:
only company that held this
Prasanna Malaiyandi:
article.
Prasanna Malaiyandi:
W. Curtis Preston: Yeah.
Prasanna Malaiyandi:
And, and that, that's why what I was using the internet, uh,
Prasanna Malaiyandi:
archive for and, uh, the mu app.com was the, was the website and it.
Prasanna Malaiyandi:
Like I said, it, it showed that it went up for purchase and then it
Prasanna Malaiyandi:
stayed that, that same way, uh, for another, uh, like a year and a half.
Prasanna Malaiyandi:
And then it got bought by a Japanese anime artist, which is a really weird
Prasanna Malaiyandi:
domain for a Japanese anime artist.
Prasanna Malaiyandi:
But, uh, in 2021.
Prasanna Malaiyandi:
And the, the co-founder that was just, that was mentioned in the
Prasanna Malaiyandi:
article, uh, left the company a few months later, um, about.
Prasanna Malaiyandi:
I, I think they might have tried to make a go of it with what was in
Prasanna Malaiyandi:
their, you know, memory or something.
Prasanna Malaiyandi:
Tried to bring the, the, you know, again, that's just pure conjecture,
Prasanna Malaiyandi:
but the, the company ceased to exist, uh, in, essentially in 2020.
Prasanna Malaiyandi:
It's a sad, sad story from a single mistake of an admin, an entire company
Prasanna Malaiyandi:
goes bust because they didn't have a backup of their, uh, cloud data.
Prasanna Malaiyandi:
Yep.
Prasanna Malaiyandi:
that's scary, right?
Prasanna Malaiyandi:
When you think about
Prasanna Malaiyandi:
W. Curtis Preston: Yeah.
Prasanna Malaiyandi:
Because it's not just the company, right?
Prasanna Malaiyandi:
It's all the time and effort all the employees put in, right?
Prasanna Malaiyandi:
All the customers who were hoping and buying products based on
Prasanna Malaiyandi:
what they were promised, right?
Prasanna Malaiyandi:
All of the things that they wanted, it's all like, poof.
Prasanna Malaiyandi:
Gone.
Prasanna Malaiyandi:
W. Curtis Preston: Yeah, yeah.
Prasanna Malaiyandi:
And all the, all those poor employees that were hoping probably for some,
Prasanna Malaiyandi:
uh, IPO, you know, payout or some kind of acquisition or whatever.
Prasanna Malaiyandi:
Obviously all that goes by.
Prasanna Malaiyandi:
Um, so when we think about this, what kind of
Prasanna Malaiyandi:
thoughts come to your mind?
Prasanna Malaiyandi:
Well, the first, of course, and I know like
Prasanna Malaiyandi:
we always like to talk about this, is backup, backup, backup, right?
Prasanna Malaiyandi:
Don't trust that your cloud provider is going to be backing up your data.
Prasanna Malaiyandi:
Do your backups yourselves.
Prasanna Malaiyandi:
Keep a copy because that could easily have saved this company.
Prasanna Malaiyandi:
W. Curtis Preston: Yeah, it would've made it a non-event.
Prasanna Malaiyandi:
. It'd be a nice story to tell a cocktail parties about the time
Prasanna Malaiyandi:
we almost lost the company.
Prasanna Malaiyandi:
But, uh, and, and that admin would still have a job.
Prasanna Malaiyandi:
Right?
Prasanna Malaiyandi:
But unfortunately, they weren't backing it up.
Prasanna Malaiyandi:
And again, this was a SaaS service.
Prasanna Malaiyandi:
Right?
Prasanna Malaiyandi:
Let's just make sure we understand this.
Prasanna Malaiyandi:
This wasn't the same as the first story that we talked about.
Prasanna Malaiyandi:
That was an IAS service infrastructure as a service.
Prasanna Malaiyandi:
This was a software as a service.
Prasanna Malaiyandi:
This was Google Drive.
Prasanna Malaiyandi:
This was.
Prasanna Malaiyandi:
Google Workspace, which is now what it, which is what it's now called.
Prasanna Malaiyandi:
And, um, they had stored their entire world in that and then deleted it.
Prasanna Malaiyandi:
If this story doesn't prove to you that SaaS services aren't
Prasanna Malaiyandi:
backing up your data, number one.
Prasanna Malaiyandi:
Number two, that they have no legal obligation to bring your
Prasanna Malaiyandi:
data back when you lose it.
Prasanna Malaiyandi:
Um, I, I don't know what story would, right.
Prasanna Malaiyandi:
Yeah.
Prasanna Malaiyandi:
W. Curtis Preston: Uh, 'cause they were sued, right?
Prasanna Malaiyandi:
They did a, I mean, it was a, it was a hastily filed, uh, you know, sort
Prasanna Malaiyandi:
of poorly written, uh, filing, but it.
Prasanna Malaiyandi:
It, they withdrew it for a, a couple weeks later.
Prasanna Malaiyandi:
Right.
Prasanna Malaiyandi:
Uh, we don't have any details on that, but it, it wasn't good.
Prasanna Malaiyandi:
Uh, the other thing is, you know, again, I mentioned it already, but
Prasanna Malaiyandi:
just to remember that, uh, you know, I, I, I often like to throw out
Prasanna Malaiyandi:
the phrase from Shakespeare, right?
Prasanna Malaiyandi:
There's, there's more on, there's more in heaven and earth that
Prasanna Malaiyandi:
is dreamt of in your philosophy.
Prasanna Malaiyandi:
And I, I think sometimes we focus a little bit too much lately
Prasanna Malaiyandi:
on cyber attacks and things.
Prasanna Malaiyandi:
Just realize sometimes people just do dumb stuff.
Prasanna Malaiyandi:
Fact, um, in fact, there's a couple of the stories that we have coming.
Prasanna Malaiyandi:
It's just somebody doing something dumb.
Prasanna Malaiyandi:
Somebody making a, a fat finger.
Prasanna Malaiyandi:
The title of the headline for this was, you know, admin Fat Fingers.
Prasanna Malaiyandi:
This company and, and basically deletes this whole company.
Prasanna Malaiyandi:
So just realize it's, it's human error.
Prasanna Malaiyandi:
Prior to hackers taking over everything, human error was the
Prasanna Malaiyandi:
number one reason we did restore.
Prasanna Malaiyandi:
Right now it's human error and direction.
Prasanna Malaiyandi:
I don't know how, what category you wanna put that is, it's not always hackers.
Prasanna Malaiyandi:
So the next one is really around keeping personal
Prasanna Malaiyandi:
stuff on your corporate drive.
Prasanna Malaiyandi:
I know it's hard.
Prasanna Malaiyandi:
Everyone works remotely, right?
Prasanna Malaiyandi:
You have a laptop.
Prasanna Malaiyandi:
It's like, oh, it's too hard for me to go grab a personal device and
Prasanna Malaiyandi:
start using that for personal stuff.
Prasanna Malaiyandi:
Like who doesn't log into Gmail from their work computer, honestly, right?
Prasanna Malaiyandi:
Or from their phone.
Prasanna Malaiyandi:
And so things do intermix, but the problem is what happens on a corporate drive?
Prasanna Malaiyandi:
Don't expect it.
Prasanna Malaiyandi:
If it's your personal stuff that it will be kept forever and that it's safe, right?
Prasanna Malaiyandi:
Personal stuff you should really take ownership of.
Prasanna Malaiyandi:
W. Curtis Preston: Not to mention that by putting medical information
Prasanna Malaiyandi:
on a company drive, you are subjecting that company to HIPAA requirements.
Prasanna Malaiyandi:
Um, it, it's not something that you should be doing, uh, you know,
Prasanna Malaiyandi:
on your, you know, on your, uh, on, on corporate systems, right?
Prasanna Malaiyandi:
Just not.
Prasanna Malaiyandi:
Yeah.
Prasanna Malaiyandi:
There, there's no, not to mention, you leave the company, right?
Prasanna Malaiyandi:
You're laid off, you're fired.
Prasanna Malaiyandi:
Uh, you know, they, they have no obligation to give you that data back.
Prasanna Malaiyandi:
Right?
Prasanna Malaiyandi:
Um, the other thing is, again, that I would just wanna mention that one of the
Prasanna Malaiyandi:
reasons why people talk about cloud data, not needing a backup as they're like, oh,
Prasanna Malaiyandi:
well, there's always this recycle bin.
Prasanna Malaiyandi:
Some deletions aren't covered by the recycle bin.
Prasanna Malaiyandi:
Deletion.
Prasanna Malaiyandi:
W. Curtis Preston: yeah, it sounds like account deletions.
Prasanna Malaiyandi:
There are things that you can do in Salesforce.
Prasanna Malaiyandi:
I was looking at a company that is specializing in backing up intra, which
Prasanna Malaiyandi:
is what Microsoft Azure AD is now called.
Prasanna Malaiyandi:
They were listing a handful of things that.
Prasanna Malaiyandi:
When you mess them up in intra, they're not covered by the recycle bin.
Prasanna Malaiyandi:
And this is another example, is that there are a number of things, again, there
Prasanna Malaiyandi:
are more things in heaven on earth than you are dreamt of, uh, in Salesforce.
Prasanna Malaiyandi:
I know for example, when you change a record, not when you delete
Prasanna Malaiyandi:
a record, but when you change a record, uh, that's not covered by
Prasanna Malaiyandi:
the recycle bin, they don't put the old version of That record.
Prasanna Malaiyandi:
That would be crazy if they did
Prasanna Malaiyandi:
that
Prasanna Malaiyandi:
Could you imagine?
Prasanna Malaiyandi:
I think this just goes to the point that backups are critical.
Prasanna Malaiyandi:
You can't trust what, that, there aren't going to ever be
Prasanna Malaiyandi:
these types of events, right?
Prasanna Malaiyandi:
That just go and don't have a recycle bin or maybe even the product doesn't
Prasanna Malaiyandi:
even have a recycle bin or your admin disabled the recycle bin.
Prasanna Malaiyandi:
What are you gonna do at that point?
Prasanna Malaiyandi:
W. Curtis Preston: Or the a or, or the hacker is able to clear out the
Prasanna Malaiyandi:
recycle bin because recycle bins can be cleared out, uh, manually.
Prasanna Malaiyandi:
Or what they can do is they can set the versions to one, you know, all
Prasanna Malaiyandi:
these, you know, they're, they're just, it's just a whole bunch of things.
Prasanna Malaiyandi:
This is why we back up.
Prasanna Malaiyandi:
Right.
Prasanna Malaiyandi:
This is, this is why it's just so frustrating to me that
Prasanna Malaiyandi:
there are groups of people.
Prasanna Malaiyandi:
Um, some of them who specialize in the platforms that we're talking
Prasanna Malaiyandi:
about who say, oh, well you don't really have to bag it up, um, despite.
Prasanna Malaiyandi:
There's a story, at least one story for every major platform we talk
Prasanna Malaiyandi:
about, and we're gonna cover those stories in subsequent episodes.
Prasanna Malaiyandi:
So yeah, so back up, back up, back up.
Prasanna Malaiyandi:
Um, and, and make sure that that backup is stored somewhere other than
Prasanna Malaiyandi:
the thing we're talking about, right?
Prasanna Malaiyandi:
Because that's the other problem with the recycle bin,
Prasanna Malaiyandi:
is that it's stored inside the thing, right?
Prasanna Malaiyandi:
Um,
Prasanna Malaiyandi:
or
Prasanna Malaiyandi:
versioning is stored inside the
Prasanna Malaiyandi:
thing.
Prasanna Malaiyandi:
Or in this case, if they had backed it up to
Prasanna Malaiyandi:
say a Google Drive under the same account, that wouldn't have saved them
Prasanna Malaiyandi:
W. Curtis Preston: That wouldn't have saved them.
Prasanna Malaiyandi:
Yeah.
Prasanna Malaiyandi:
Yeah.
Prasanna Malaiyandi:
You need to back it up to another account, um, uh, you know, to another account.
Prasanna Malaiyandi:
You know, if we're talking about cloud to cloud backups, just make sure it's
Prasanna Malaiyandi:
backed up to another account that has different, you know, authentication
Prasanna Malaiyandi:
authorization and has really, really tight lease privilege turned on.
Prasanna Malaiyandi:
Uh.
Prasanna Malaiyandi:
And a different region perhaps.
Prasanna Malaiyandi:
Right?
Prasanna Malaiyandi:
Um, you know, there are other services to pull it outta the cloud if that's what
Prasanna Malaiyandi:
you wanna do, but just make sure you're not leaving it all on the same place.
Prasanna Malaiyandi:
Um, there are services to back up Google Drive.
Prasanna Malaiyandi:
There are services to back up all of the things that we're talking about.
Prasanna Malaiyandi:
And, uh, that would be my favorite way.
Prasanna Malaiyandi:
If we're talking about how to back up the cloud, my favorite way to back up the
Prasanna Malaiyandi:
cloud would be to back it up to the cloud, do cloud to cloud backups, but back it
Prasanna Malaiyandi:
up to another service that you're paying
Prasanna Malaiyandi:
to do this.
Prasanna Malaiyandi:
Right, right.
Prasanna Malaiyandi:
Um,
Prasanna Malaiyandi:
I'm laugh you, you know why I'm laughing
Prasanna Malaiyandi:
W. Curtis Preston: Why?
Prasanna Malaiyandi:
Because you bought into the cloud service because you didn't
Prasanna Malaiyandi:
wanna manage equipment, infrastructure, patching, all of that stuff.
Prasanna Malaiyandi:
And if you went and you're like, Hey, I'm gonna go deploy an on-premises
Prasanna Malaiyandi:
backup solution so I can pull my data down from the cloud because I wanna
Prasanna Malaiyandi:
manage it and I want to do all the other stuff, that just seems kind of backwards.
Prasanna Malaiyandi:
W. Curtis Preston: Yeah, I know, I know there's at least one major
Prasanna Malaiyandi:
company that does it this way.
Prasanna Malaiyandi:
Uh, and I'm not saying it's necessarily wrong.
Prasanna Malaiyandi:
It just doesn't,
Prasanna Malaiyandi:
it doesn't seem right.
Prasanna Malaiyandi:
Right.
Prasanna Malaiyandi:
Yeah, unless you have a very specific use case for
Prasanna Malaiyandi:
needing that particular solution, I could imagine there are cases
Prasanna Malaiyandi:
W. Curtis Preston: I will, I will say that there are those who
Prasanna Malaiyandi:
disagree with me and feel that.
Prasanna Malaiyandi:
We wanna get it out of the cloud for backup reasons, right?
Prasanna Malaiyandi:
That, that, that the cloud is somehow inherently untrustable, for example.
Prasanna Malaiyandi:
And so we're gonna pull it out of the cloud and, and store
Prasanna Malaiyandi:
it in the, in a data center.
Prasanna Malaiyandi:
And I, I just disagree with those people.
Prasanna Malaiyandi:
Um, you know,
Prasanna Malaiyandi:
we, we can, we could agree to disagree on that one,
Prasanna Malaiyandi:
Yeah.
Prasanna Malaiyandi:
Well, I'll give you
Prasanna Malaiyandi:
a perfect example is data sovereignty
Prasanna Malaiyandi:
requirements might dictate that you pull it out
Prasanna Malaiyandi:
and hold it locally.
Prasanna Malaiyandi:
W. Curtis Preston: Yeah, it might be, that might be, it might be a, a valid example
Prasanna Malaiyandi:
or a reason why you might want to do that.
Prasanna Malaiyandi:
So, well, uh, our second sad story from the
Prasanna Malaiyandi:
series,
Prasanna Malaiyandi:
so
Prasanna Malaiyandi:
thanks.
Prasanna Malaiyandi:
Thanks for helping me tell the story persona.
Prasanna Malaiyandi:
I am so depressed, Curtis, but hopefully it's
Prasanna Malaiyandi:
a learning lesson for other folks.
Prasanna Malaiyandi:
W. Curtis Preston: Yeah.
Prasanna Malaiyandi:
We don't want anyone experiencing schaudenfreude, right?
Prasanna Malaiyandi:
Uh, we don't want them taking joy in these misfortunes.
Prasanna Malaiyandi:
We want them learning, uh, from these misfortunes.
Prasanna Malaiyandi:
We can definitely do that.
Prasanna Malaiyandi:
And with that I want to thank our listeners.
Prasanna Malaiyandi:
Be sure to subscribe so that you don't miss an episode.
Prasanna Malaiyandi:
That is a wrap.
Listen On
