Ah, you should have let me know about it back then, would have saved the entire thing, even if it might have involved a complicated access routine.Originally Posted by calikid
Two other sites are claiming rights, under the DMCA, and forced Mr. John Greenewald to remove the material.
IMO it is very wrong for a private company to claim information generated by public funds (ie My US Tax dollars/USAF) should be reserved for profit.
It is one thing to write a book (copyrighted) that includes the information, but also provides insights and opinions on the subject. But the raw material should remain public domain.
I was systematically saving each individual report for personal use/research.
Unfortunately, the only way was to open each report and save to local hard drive, a time consuming process. Sadly, I only got through the 1940's, and was about to begin saving the 1950 reports and then onto the 1960s.
Figured about a month to copy the entire archive.
I had discussed the possibilities of bulk downloads with Mr. John Greenewald, he said "not available at this time".
To bad.
Who knows?
Maybe someone else managed to D/L the entire archive and we will see it posted to torrents.
Good luck (NOT) to those private companies whistling it back from TPB, if it ever hits the proxy links.
Just for future reference (and this should be posted in a dedicated resource thread) if you add any URL to the end of this URL, the internet archive will automatically crawl it "on the spot demand". It won't crawl any pages linked to the page like the main crawling thread, but it will make a snapshot of a single page instance.
After a few hours the crawler will then re-link (properly) any series of pages that were directly crawled.
I have used it recently to make a copy of a forum.
==================
https://web.archive.org/save/
For example, if you wanted to save this page it would be:
https://web.archive.org/save/http://...-the-web/page4
==================
You can add as many as you want (literally thousands of requests), as it will time stamp each version at the time it received the URL from you. It will take about 24 hours for the internet archive software to re-index all the submitted (grabbed) pages against other pages. It might also look a bit weird until the 24 hours has passed.
Each grabbed page will be an "island" on its own until 24 hours have passed and then it will find logical connections between pages and make it cohesive again. It's important to keep that in mind as it is not the same as submitting a general site and then waiting until one of the main crawlers gets to it someday.
If you want to see what versions there are of any specific address at the internet archive you can look it up by using this format:
https://web.archive.org/web/*/http:/...ostforum.com/*
Hope it helps the next time you see something worth grabbing.
Reply With Quote
