digital hoarding
So perhaps i am a bit overexaggerating and maybe being a bit self-deprecating with the title but, hear me out.
With the explosion of storage prices recently, there was a conversation in a peer group where we discussed how much storage we got, and I think mine came to over a whopping 35TB, which is a bit insane if you think about it. Just a day before I wrote this, it got reduced down to 28TB-ish, and during this time where storage is barely affordable, so life is not all dandy. Anyway, it got me thinking. Surely it's not just me who hoards digital stuff. Sure it may not be as much as double digit TBs but surely people got something stored on their storages apart from what is on their computers!
So lets talk a little bit about that.
is it really hoarding?
I admit the title is maybe trying to be a little clickbait-y. Over the years, several times friends, relatives and other have approached me with a case of loss of data - either a broken storage device, a virus, accidental deletion or otherwise. And the stuff they want recovered is genuinely important to them. For those in tech, concepts like double backups of important things is a norm and not an outlier. Unfortunately, that is still not the case for the average person. I do not believe the general public is still that aware of the importance of such concepts and/or they just put too much reliance of tech and hoping it won't fail them. And in every one of those cases, they learn a bitter lesson sooner or later.
So yes, for most people it is not even hoarding. Just trying to preserve important things in their life. Important documents. Precious memories as photos or videos. So at which point does it become hoarding?
storage over the years
Folk today may not know how it was like back in the day. YouTube and online streaming is not a thing. And even if it was, the internet speed and costs were too cost prohibitive for the average person to enjoy such luxuries. So most entertainment consumed back then comes in some sort of physical storage medium. In earliest days it was in VHS tapes and cassettes. Video went in the former and audio/music in the latter.
And they are not even digital storages per-se. They are for all purposes, analogue. Then came CDs and USB drives. They are very much digital. And more versatile. You could put pretty much anything you wanted in there. Movies, music, software, documents, pictures, the list goes on. "Hoarders" of that time had a vast collection of those. USB storage was expensive. But CD and DVDs were cheap. So it was frequently used. I can still remember possessing a cd bundle thingy of all my pictures and favorite anime (during my anime phase). I could stick like 50 CDs in there. A whopping 35GBs of storage!
External hard drives soon became a thing after. And that was a game changer. USD storage was painfully slow for most cases. But very portable so it was a preferred way of carrying office data and even used as personal storage by some. Mind you the capacity of such devices was not high at the time. You have anything from 128MB to 1GB devices, with the top end being barely affordable. I still remember a cousin purchasing a 256MB USB drive for the price which would get you a 1TB external hard drive these days even with the exploding prices. Regardless, it slowly changed the way people stored things. There was a time when I thought CDs and DVDs were going to be the future. But that was short lived. They slowly began phasing out in favor of USB drives and external hdds.
The current trend appeared not long after too. Cloud storage. Arguably more superior form of storage because you had a very small to no chance of losing your data. People who had bitter experiences with persona storage devices saw this as a natural next option. Most services even back then offered free storage. Some even insanely bigger storage spaces than most like Google and Microsoft during their initial days. Only problem for most was the slow speed of access. But that didn't matter as it was the permanent storage that attracted them. They were willing to sacrifice the speed of access for the comfort of knowing it is safe for later retrieval. Not very long ago however, these services started changing their terms. People started hoarding too much I guess. Free offerings were being overused maybe. Their free offerings started to get small. Some didn't mind paying for their storage. Again, because of the comfort it brought. The best example of this would be Apple iCloud users who are very contempt with paying the subscription for the nice backup service it provides for their whole apple ecosystem.
So that brings us to today. Cloud storage is a norm, yes. But any meaningful amount of storage costs a subscription. Some pay. Some are fine with the size of the free offering it brings. And some still prefer the old method of storing things in external disks. And some like me, goes a bit beyond.
case for local storage
People prefer local storage over cloud for various reasons.
- It provides more control. Accessing it, putting new things, removing things, managing it, all is much easier with local storage. Faster too since there is no cloud upload or download. Experience techies can also make the data accessible anywhere pretty much like any cloud service.
- Privacy. I say the average citizen is not very concerned (or at least not as concerned as they should be) when they opt to put everything in their lives on cloud storage. Pretty much all cloud storage providers today openly tells you they train their AI on your data including family pictures and documents. OneDrive for example, it is quite difficult to opt yourself out of it. The predatory practices are out of control. But at the same time, not a big concern for the average citizen, given they happily upload their own face and their families faces to AI systems to generate funny images or vides. This is a different time indeed. Meanwhile, others are not the same. They do not want any of that, so they opt to not use these online services.
- "Secure". The term is very controversial in tech industry. What does that even mean. Less prone to loss? Less likely to be seen/accessed by unwanted parties? Both cloud and local storage provides (or at least claims it provides) these things. Local storage for instance can be encrypted, so even in case of theft, your data is not seen by others. But at the same time, that data is lost. On cloud, it is protected from others with credentials. But their privacy policies clearly dictate that they can access your data as required by law or whatever. But at the same time, very unlikely to be lost by accident.
- Accessibility: Both can be accessible and not accessible at the same time. When there is no internet or having internet issues, your local data is still available. Anywhere access is also possible with both, with cloud having native support while local storage requires additional effort, but nowhere near impossible.
- Cost: Obviously a big factor. Local storage is dirt cheap compared to cloud storage. The risk of losing it higher though. Most hard disks are extremely prone to sudden data loss. But those who opt for such methods often account for this and have backups and other precautions in place.
Anyway, the list can go on. But what is my personal stance on this?
Well. It is a mix. Privacy, yes. Control, yes. Security, accessibility and cost, also yes. But there is more.
"Once it is no the internet it is there forever"
This is quite a famous saying that goes back ages. People were inclined to believe that. Especially in cases of shameful things being leaked and publicised. Accessing all kinds of things were pretty simple back in the day. But does that really hold true today?
To answer that question, I have two things to ask you:
- is your favourite website from 2010s still alive and kicking today?
- what is the oldest piece of data you have with you?
I know for a fact that all my favourite forums are now defunct. And the oldest piece of data I have is roughly 21 years old, and that too are some pics I keep very preciously. From my personal experience I had a feeling that it is not a very "typical human" thing to retain data for that long so I had to look up if there is research on this. And guess what. There is, and my hunch was right. In fact, it turns out average person only retains data for two device migrations, which is roughly 10 years or so. Most data retain for like 5 years. My 20+ year retention is specifically because I am in the outlier group (a lot of techies are in that way. Digital hoarder too).
And that is only the surface. What about your favourite game from 20 years ago? Can you still access it? Or play it.
What about your favourite TV show from 20 years ago? Still available to watch?
What about the pictures and videos of your family and friends? Still available? What about recordings of memorable events from back then? Stage shows? Singing competitions? Still watchable?
Perhaps these are absurd examples since some of you weren't even born 20 years ago. So lets go with a simpler example. What about your bookmarks from maybe even a year ago? All of them still works?
It's a bit ironic, isn't it? Even as data storage and retention becomes more and more accessible, the amount of data that you retain still remains largely unchanged. Average life of data hasn't changed much. So what gives?
Well I am not enough expert to answer that question. And all I have are some of my own theories. But I think we can all agree that the "once it is on the internet, it is there forever" no longer holds true.
changing paradigm
The internet used to be a different place. Some called it a magical space. Different corners of the internet are rich and abandon with their own niches. People expressing themselves in their own interest groups. The occasional troll. But you can always find a place where you can belong and call yourself home. I had several forums that I can call the same. I was a newcomer first, naturally. But as time went on, you start knowing people. Start interacting with them more. Eventually you get to know each other well enough. Form friendships even. Much like an IRL friendship, but online. Stuff you shared with them on those forums - you never though they will go away one day. It always felt like it will be there forever.
But that was obviously not the case. See the thing with internet is, it costs money. And when money is involved, there is profits involved. Good old capitalism. What doesn't make you money is not worth keeping long term. And that was the case with most thigs. You either become profitable or you go away. Niche corners of the internet are not immune from this. A personal hobby project like a small forum may start small. Might cost only a penny. Affordable. But if it stats growing, so will the bill. Eventually your hobby becomes are burden. You have to make money off it.
There is a term coined by some dude recently called "Enshitification". A rather crude term, but highly accurate. For those who don't know, it has three parts. 1. You attract a huge user base with an attractive and cheap/free product. You get them onboard (and leave whatever was the alternative behind). 2. When you have enough users and when the previous alternative competition is all but gone, you slowly start charging users. Users become customers. But you are already locked in and can't leave because the alternatives are no longer there. 3. and final is the services get "shitter" over time, hence the "shitification" in enshitification. Ads everywhere and more intrusive. All nice features locked behind subscriptions. Data is harvested and abused with no opt-out. The business wants more profits. And more profits than last year.
I believe enshitification is the primary driving factor of the current trend of all your favorite things losing their appeal. Lets look at some examples.
- Photobucket: The go-to image uploader and share service from back in the days. Everyone I know used it to hotlink in forums. For free. Their sudden move to monetize it drove its customers away. Now it is a husk of what it once was.
- GeoCities: More or less similar to Photobucket. But with a more devastating outcome. Estimate 30 million plus pages of internet history wiped out.
- MySpace: An example of killing competition and enshitificaiton by Facebook. A victim. Still alive today but a husk of what it used to be.
- Sharing and Warez forums: These were doomed from day one anyway. While they strongly stand by the fact that they do not host any copyright infringed content on their website, it is hard to argue against the most well-paid teams of lawyers the world has to offer. But damned if it wasn't to sad to see some of those sites go. Mind you, I was not even there for the mainstream content. Most of the times, it was just for the fun we had in the forums.
The point in case, all things eventually go away. The internet is indeed not forever.
digital preservation
Instead of hoarding, I'd like to use a more dignified term. "preservation". I'm sure this is not the first time you've heard of it. There are already large international movements doing exactly that - digital preservation. Their primary goal is to ensure that digital things do not vanish or become unusable in the future. A very simple local example. Accent Xpress. Most of you are not even old enough to know what that even means. But for those of us who do, think about what happened to all the documents written on it. And there was a lot. But can you view them today?
As the internet exploded and the number of digital content on it kept ballooning, meanwhile software kept being updated, people noticed this dangerous trend early on. Standards like the JPEG and ODF standards heled but there was always more. Proprietary standards were inevitable. PDF is a perfect example of this. Back when they were not so predatory, they agreed to the PDF/A standard and I guess sort of pinky promised that all the future versions will support viewing the PDF/A format files even generations later. That is a bold undertaking. But a very useful one. Unfortunately the same treatment did not extend everywhere.
Take a look at games for example. A lot of old school games are now unplayable for various reasons. The console is no longer available for purchase. The current version of OS no longer supports it. System hardware no longer supports. But not much could be done about it. They were all proprietary. So it was all up the mercy of their creators. And all of them chose money over matter. They'd rather let an iconic piece of history die than someone else enjoy without reaping massive benefits out of it. Such is capitalism.
Which brings me to my point. Hoarding may not always be about just hoarding. It can also mean preservation. It is difficult to imagine something on a website like, say, Facebook, to suddenly disappear and never be accessible again. But when it finally happens you're thinking "man! why didn't I think of making a copy of that!". But it is too late. As the old saying goes, "You never know the value of something until you lose it". But these two things do feel like silly contradictions isn't it. For instance, what value do you think today for a copy of an a electricity bill I paid for the month of April 12 years ago? When you don't find value in things, you typically chose to remove it from memory and storage. Other things are an easier choice though. Like the first pictures of your children. I guess those are no-brainers for most.
so, not really hoarding?
I guess the notion takes a different turn when you consider non-personal and commercial things. Movies, music, TV shows etc. Applying the same concept as above, lets say you have "preserved" some of such media. Question is, how much is considered too much? Also, is it really necessary? The video screaming era has really made a lot of such hoarding unnecessary. Fans of all avenues of media, be it anime, movies, Korean dramas or otherwise, there is always one or several online streaming sites providing the service. And internet these days is cheap enough to consume them without worrying about bills going through the roof.
But there is the other side. More than once these streaming sites randomly just remove things from their libraries. Netflix is notoriously famous for this. Sometimes even the ones you explicitly paid for and ""bought"". It was the odd case here and there back then but now it is a common place. And if you read the fine print you'll notice you didn't buy anything. What you "bought" was a limited license to view the content for as long as they see fit. So, a subscription. Not a purchase.
You not having any control over the things you purchased is indeed a slippery slope. As a gamer myself, Steam is one of those interesting predicaments. Hundreds of dollars spent on "buying" games but the truth of the matter is, they can take it away at any time they want. So far, the only thing going on for them is the goodwill of Gaben. I may be comfortable leaving all my games in an online platform right now but, what if it changes tomorrow? What do I do then? Acquire "unofficial" means of playing those games from other sources? Or accept the fact that those purchases were never a purchase, but a license subscription? Because the purchase button surely said "buy" and not "subscribe".
My point is, when you feel like you have no control over the things you paid for, you find other ways of having the said control.
current situation
All while this is happening, something worse is brewing on the other side. The cost of storage and almost tripled within less than a year. And industry experts are saying there is a change the costs will never come down in the future. At least not for a foreseeable future. This is especially bad news for people who are digital preservationists as the cost of their work or hobby or whatever is now tripled. The life of a hard disk doesn't extend for than half a decade on average. The quality of the items we store is also increasing. The amount of storage per dollar you get is tripled. This is what you call "a series of unfortunate events". So now I got to make harsh reality calls. "Do I really need to keep this?". "Will I ever get to use this thing later?" and so on. And all things that fail are now going to the dumpster, or the yolo section. If they die, they die. There is no bringing them back. And some of them are indeed near impossible to find on the public internet.
It is a sad day to be a hoarder.
in conclusion
I say, do what you love. If you love hoarding preserving digital things, then keep doing that. The future indeed looks bleak and you may not get to enjoy your favorite media in the future as you do now.