[Documentary] Archive of /r/MegaLinks [211MB]

sevengali | 484 points | Mar 30 2018 01:27:16

[Documentary] Archive of /r/MegaLinks [211MB] | Megalinks MegaDB [Documentary] Archive of /r/MegaLinks [211MB]

Edit: 275MB

I have undertaken archiving subreddit I feel may soon be taken down, the various Mega subreddits being one of my main concerns.

This is an archive of /r/MegaLinks. An explanation of this archival, links to more archives, and possibly more up to date links are available here:

/r/sevengali/comments/881nty/reddit_archive/

Mods - I'm posting these as separate posts for people searching. Please let me know if you'd rather I group them together.

You know the drill, just the link.

Link: aHR0cHM6Ly9tZWdhLm56LyMhSGJRVnlSb0E=

Key: !GYiD36IS2CFrz6iB9iTf6EV3eG03KJFUfYz7699-fQw

[-] jomiran | 30 points | Mar 30 2018 04:06:34

I was reading your DataHoarder thread and I have two questions.

When you pull the text, are you pulling the "source text" or "display text"? I ask because many post have the "remove bold text" requirement and if you aren't pulling full source text which includes the **boldtext** code, then all those posts will be unusable.
Do archives of posts that include links using the [text](url) method show the URL used in the link or just the [text]?

[-] sevengali | 10 points | Mar 30 2018 08:57:27

Good questions! Both of these work well. For example, this Blade Runner post looks like this when archived.

https://i.imgur.com/M5vuazY.png

[-] meseeks_programmer | 3 points | Mar 30 2018 04:12:34

if you look at the one I posted. It has full formatting saved in 'body_html' property in the jsons.

[-] WillNyeThePornoGuy | 19 points | Mar 30 2018 04:18:16

I just found this sub, it can't be taken away so soon!

[-] DeliriousSchmuck | 18 points | Mar 30 2018 11:07:13

Cut off one head, two more grow back.

[-] doobsftw | 7 points | Mar 30 2018 18:11:47

Hail Hydra

[-] TimeLord-007 | 8 points | Mar 30 2018 06:39:44

The download was only like 98.1 Mbs, is that okay?

[-] sevengali | 9 points | Mar 30 2018 08:53:34

Should be 275MB (I got it wrong in the title somehow...) after you extract it

[-] meseeks_programmer | 6 points | Mar 30 2018 03:57:45

Here is my backup as well. I had the same idea lmao. with some pre parsing into smaller files based on content type... tv/movies/education/ect..

b64 encoded

aHR0cHM6Ly9tZWdhLm56LyNGIUtvSWwyU3lRIUM5UmkxZ2t2ZHpXc3h6MjRwUFBpTmc=

to view the large 50mb one use this https://development.wellisolutions.de/huge-json-viewer/

[-] Nervous_Wallaby | 6 points | Mar 30 2018 11:00:45

Noob here.

The files are in .JSON format, how do you open them bro?

[-] jomiran | 4 points | Mar 30 2018 13:11:27

They are text files that follow a certain formatting, like html and xml files. You can read the raw text or use an app to read and display it.

[-] ElegantBiscuit | 3 points | Mar 30 2018 13:57:25

Notepad or textedit I think is the easiest way

[-] Snolferd | 6 points | Mar 30 2018 08:45:39

Do you think there is a way to automatically have all 40000+ files to have the names of the titles?

[-] sevengali | 11 points | Mar 30 2018 08:53:17

Soon I will go through and redo these, more up to date and with better titles, but one as big as MegaLinks takes a while to do

[-] Snolferd | 5 points | Mar 30 2018 09:33:11

Awesome

[-] ValtoSilver | 2 points | Mar 30 2018 10:35:23

Holy I'll have to give this a try

[-] Eyedoless | 2 points | Mar 30 2018 15:50:23

Hey dude, thanks for this!

I'm having a problem, though. After decoding the key, it says it's invalid. There are two little boxes where characters should be. similar to if you were to try to view an emoji on a PC. What am I doing wrong?

[-] sevengali | 2 points | Mar 30 2018 16:07:49

Only the link is encoded :)

[-] Eyedoless | 2 points | Mar 30 2018 16:17:04

Oh I'm an idiot. I guess I can't read haha. Thanks!

[-] Doip | 2 points | Apr 01 2018 17:20:49

Happy cake day

[-] sevengali | 1 points | Apr 01 2018 18:13:19

Thank you :)

[-] PhiWeaver | 1 points | Mar 30 2018 23:15:59

Where are the post names?
In the db file?

[-] sevengali | 1 points | Mar 31 2018 10:29:23

Yes. A future update (within a week) will have the names as the html file names

[-] [deleted] | 0 points | Mar 30 2018 12:29:31

[deleted]

[-] sevengali | 3 points | Mar 30 2018 12:31:24

Link is base64, key is not

Base64decode.org

[-] HappyBittu | 2 points | Mar 30 2018 12:58:00

Extracting in phone it says "exception found, divide by zero!"

[-] sevengali | 2 points | Mar 30 2018 13:08:09

Extracting the zip? What phone, OS version and app are you using to extract?

[-] Gadetron | -6 points | Mar 30 2018 06:28:56

Reddit needs to stop deleting things that offend people. That offends me, so stop it reddit, don't force us to use voat.