Broken image links

Tramponline · Mon 20/05/2013 17:13:09

Arj0n, you are officially awesome!

AGA · Mon 20/05/2013 17:47:08

Quote from: Radiant on Mon 20/05/2013 15:13:31
Quote from: Tramponline on Mon 20/05/2013 13:19:41
The broken download links list contains only reports from users/members as far as I know. In each entry the link 'If the download link or mirror link doesn't work, please report it.' --> then confirm broken link.
Would it be possible to automate this? For instance, a script could automatically open all URLs and see which ones (1) return either a 404 or a Domain Not Found error, (2) go directly to an EXE file, which is assumed to be the valid download, or (3) show a webpage presumably containing a download link. The latter category would still have to be checked manually eventually, but this could be a big timesaver for categories 1 and 2.

It's not as simple as that though. For instance, I believe a RapidShare / MediaFire type page would return a 200 status code even if the download was no longer valid. A lot of the games page links don't link directly to the games files, they link to the download from the page linked in the games database. And recursing links automatically is both tricky and potentially dangerous. Plus there are a lot more status codes than just 200 and 404! There are about 600 direct links to .zip, .rar and .exe files, which would be easier to mirror (and mark as valid) automatically, but the other 2/3 might have to be done by hand.

Leon · Mon 20/05/2013 19:26:11

Quote from: Peder Johnsen+ on Mon 20/05/2013 14:59:53
You are right Tramponline, it IS a Herculean task. But like AGA mentioned, there are plans of integrations hence I'd actually like to prioritize getting the user side of the new AGSA build done first so we can start on the integration. Then I'll be able to set up a similar system to what AGA has done on the AGS site and anyone interested in helping out can start uploading games/screens where they are either missing or broken in the db.

But that's just what I said: create a list from the games db of all the games that do not point to agsarchives. Then you have to check those that don't if they exist, if they do, adjust the link, if they don't find/update/disable accordingly. Indeed a Herculean task but you have to start somewhere and you'll be doing it only once. When you try to find correct downloads now on 'public' links, you'll have to do it again in the future.

That being said, I'll update the db images with the games Arjon & Trampoline/sthomannch provided.

selmiak · Mon 20/05/2013 20:38:26

Quote from: Tramponline on Sun 19/05/2013 15:24:15
MISSING GAMES LIST
Spoiler
A walk in da tomb: Final "Normal" version in database. might be considered for deletion?
A.L.I.
Abstract
AGS Background Editor v1.4
Aliens Inc. (demo)
All Hallows' Eve
All the magical things
An Egypt Adventure
AS Racing Manager ..is there, but missing a file
Awakening - Part 1: Escape
Battle Warriors DEMO 3.0
Block PAD
Cacho Quest
Call Me George Chapter 1
Clash of Forces - Episode 2
Connect 4
Connect 4 v.2.1
Count Spatula, Volume 1 :: The Seafood Years
Crap Quest by LGM, contacted, he ain't got it!
Crazy Mansion / Maniac Mansion 3
D.Jones: Deceased
Day of School
Deflus Technical Demo
Desktop Adventures: The 11 Minute Game by LGM, contacted, he ain't got it!
Domestic Conspiracy Demo ..Vince's game, will ask him once he's back from his vacation
drugs and aliens
Everlight Forest Demo v1.1
Everlot-Demo
Forgetten Death Demo (Turkish Version)
Fractal Creator
Frankenpooper
Fribbeldib
FSi's SymDefecation ...Cat contacted FSi, he doesn't have them ATM (more games missing from him)
Game Quest
Gil: The Trillion Dollar Journey DEMO
Harrys Strange Day
Hell's Satans
Horror Hospital Incomplete Demo
I Need A Wee!
Indy y la Abadia de Effel
It ain't easy
Kill Davy Jones (demo)
Kiselyova Unleashed!
Klaus Kerner and the Fate of Atlantis
Legend of Rovendale 2 Mystic Island
Lorry Len
Lost In The Nightmare - Demo
Matt and James Amazing Game For Everyone
Meaning Quest DEMO
Mimis the rat
Mittens Mystery Extravaganza
My 40 bullets (v1.1)
N.orth E.ast W.est S.outh
New frontier ...by RaGG, contacted, hasn't signed back in yet...
Nicholas Wolfe Part I: Framed - Demo
Nightmare Demo
No Traveller Returns (DEMO)
Oceanspirit Dennis 2 Contacted icey, he'll fix it
Oldman's Quest
Once Upon a Time in Keel
Princess leaves the tower ...by RaGG, contacted, hasn't signed back in yet...
pSyCHo!@! ...Leon, you had that one, when Arj0n asked last time?
Quikstrike89's Stupid Test Game
Revenge of a guy derogatorily referred to as the n-word!
Ringo's Big Adventure
Roger's Lame Adventure
Sam&Moos and the treasure of grandpa
Season Greetings 2002 - ITA
Secret Santa Generator
Shadowgate Remake
Shooting Gallery
Simpsons Adventure Game
Simpsons Adventure Game
SkyTower Rescue Demo
SL vs AUS O7
Slime Quest 2 Demo
Smile or Die Nonplayable Demo
Soldier of Misforune
Soldier: Demonstartion
Space Madness
Stickman RPG
Stranger in Stickworld
SWEET NIGHTMARE
Sweet_Nightmare
T.I.T
Tempus Fugit
The Alien and the Hick by LGM, contacted, he ain't got it! Anyone?
The Artifact - Demo
The Case (Demo)
The Death of Luke Simpson
The Holocaust Museum by LGM, contacted, he ain't got it!
The Legacy of Taft Demo
the lord of the bytes
The Quest for my Raincoat (aka DickBoy) ...sent Layabout a PM, though he didn't answer yet.
The Strange Day
Time-Space Escape
Totaskalan
Underwater Adventures
Who Killed Who?
William in the USA
Wolf Country (DEMO) ...tried to find "aussie"'s e-mail, to no avail (I want to play that game!! Demo Award nomination and all!! )
[close]
Some more people have been contacted, but didn't answer yet.

I just went through all games with W,X,Y,Z and specialchar listed after Z

missing games adds: (note: I didn't check AGSA for them... yet)

Spoiler

Would You Be My Lover ? Demo
Wolf Country (demo) is in the list, not confirmed works for me, well at least a file is downloadable, didn't check further...

Wizardhood
williams nightmare
william in the USA confirmed
who wants to life forever
Who sent me to oblivion
who killed who confimed
where did sam go?
wet
well, well, well, what have we here? works, but the mediafire link is hidden behind some authorization, don't know if the author sets this or mediafire is annoyed of me starting download after download

An AGSArchives mirror without this would be totally okay imho
welcome to dark lake (demo)
we are vectors
~~Warning: Fragile! - Chapter I: Operation Blindhawk~~ - screenshot repaired
walters astroid

[close]

arj0n · Mon 20/05/2013 21:52:46

Quote from: selmiak on Mon 20/05/2013 20:38:26
I just went through all games with W,X,Y,Z and specialchar listed after Z

missing games adds: (note: I didn't check AGSA for them... yet)
Spoiler

Would You Be My Lover ? Demo
Wolf Country (demo) is in the list, not confirmed works for me, well at least a file is downloadable, didn't check further...
Wizardhood
williams nightmare
william in the USA confirmed
who wants to life forever
Who sent me to oblivion
who killed who confimed
where did sam go?
wet
well, well, well, what have we here? works, but the mediafire link is hidden behind some authorization, don't know if the author sets this or mediafire is annoyed of me starting download after download An AGSArchives mirror without this would be totally okay imho
welcome to dark lake (demo)
we are vectors
Warning: Fragile! - Chapter I: Operation Blindhawk - only half a screenshot, download works
walters astroid
[close]

Here's 10 of your list:

0045.Wet [MAGS]
0290.Who Wants to Live Forever
0310.Wizardhood [MAGS]
0363.Williams Nightmare [MAGS]
0363.Williams Nightmare v2 [MAGS] [Mr Frisby]
0582.Walter's Asteroid
0696.Where did Sam go
0847.Welcome to Dark Lake - DEMO
0886.Who Sent Me to Oblivion
1249.We Are Vectors
1339.Well, Well, Well, What Have We Here v1.0
1339.Well, Well, Well, What Have We Here v1.1

Uploaded the files here

Tramponline · Mon 20/05/2013 23:01:47

Quote from: selmiak on Mon 20/05/2013 20:38:26
Wolf Country (demo) is in the list, not confirmed works for me, well at least a file is downloadable, didn't check further...

LOL! I didn't only post those, I fixed 'em too...

Quote from: Tramponline on Mon 20/05/2013 17:03:36
Got three more games from the 'unavailable' list, by courtesy of 'sthomannch':

No Traveller Returns (Demo) - ...another working link(!) was in the game's "Completed Games Announcements" thread - first post!!! (hosted by SSH)

Underwater Adventures

Wolf Country (DEMO)

To be honest, I rather doubt that it makes that much sense at this point to go through our database in search of broken links and not to look up those 'broken' games in the AGSarchives at the same time (i.e. instantly fixing broken links as we go along). Almost all of the games you listed are downloadable in the AGSarchives database right now! Except mabye 2 or 3. It wouldn't be much use to mark those as broken links, since they're available (apart from those 3). The list I compiled was just for reference, those are games that aren't available in the AGSarchive database, the "Net" or our database.
My list is no good, selmiak (it's 'out of date' already), use AGA's automated ones...or is it?!? - too tired...another day.

Peder 🚀 · Tue 21/05/2013 02:34:52

There might still be games here: http://arj0n.agsarchives.com/ that is yet to be added to the AGSA db that are needed. Worth checking out I guess

.

selmiak · Tue 21/05/2013 07:08:18

I want to check AGSA for the games I listed as down today, was just too tired yesterday and thought maybe someone else already starts

I didn't mark them as broken yet too, I just went through all these W-Z games and made a list and posted it. Like delaying and in the meantime outsourceing the work to the crowd, if only there were a word for it...

AGA · Tue 21/05/2013 09:45:13

So I had a cunning idea. As the AGS Archives database is stored on the same server as the main site's, I wrote a thing that picked out all the games in the AGS database that are also in the AGSA database, and identified the URL on AGSA. Give me a while and I'll make this visible on the games page. All 953 AGSA pages will shortly be linked on the relevant AGS games page's page.

Leon · Tue 21/05/2013 10:33:32

Mind you that a page on AGSA doesn't necessarily mean a download on AGSA... There are still a number of "coming soons...."

AGA · Tue 21/05/2013 11:02:12

There are over 1000 files available in total. I'll make sure only AGSA pages with download links are linked though.

arj0n · Tue 21/05/2013 14:36:38

Can I be of any help in this process?

AGA · Tue 21/05/2013 14:41:21

If you mean the AGSA bit, that'll all be done with database queries. It'll take a few minutes when I get the chance to take a look at it. Not something anyone but me can really do!

arj0n · Tue 21/05/2013 15:08:05

Quote from: AGA on Tue 21/05/2013 14:41:21
If you mean the AGSA bit, that'll all be done with database queries. It'll take a few minutes when I get the chance to take a look at it. Not something anyone but me can really do!

Yeh, you better do the magic db stuff AGA.

I meant the whole "missing images/broken links/missing games/etc" process here

Tramponline · Tue 21/05/2013 15:56:59

That would be great, Arj0n. Especially considering your ability to make those missing games appear out of nowhere!

Some info in between: All available versions of AS Racing Manager are missing the ac2game.dat file.
~~It seems to have been downloaded 5,500 times, no comments on the entry page. Was there ever a version that actually worked? Does anyone know?~~

edit: Nevermind, it seems to have worked at some point in 2005 at least:AGS Games in Production / AS Racing Manager, however buggy.
Anyway, every zip file is missing that file so far...

And one question: I'm slowly getting somewhat confused with all the upload/download resources we have. We can't just simply link those game entries to Arj0ns uploads (or the link Peder posted: http://arj0n.agsarchives.com/) directly, or can we? We download them and upload them to sites like mediafire for now (at least that's what I did with the few games I fixed from the 'unavailable' list so far). Sorry, total noob concerning all that server mubojumbo-overhead-bandwith-limitations stuff.

arj0n · Tue 21/05/2013 16:17:58

Quote from: Tramponline on Tue 21/05/2013 15:56:59
And one question: I'm slowly getting somewhat confused with all the upload/download resources we have. We can't just simply link those game entries to Arj0ns uploads (or the link Peder posted: http://arj0n.agsarchives.com/) directly, or can we? We download them and upload them to sites like mediafire for now (at least that's what I did with the few games I fixed from the 'unavailable' list so far). Sorry, total noob concerning all that server mubojumbo-overhead-bandwith-limitations stuff.

I would NOT suggest to link them to the uploads I did, these are just temporarily.
And also NOT to my AGSA account (http://arj0n.agsarchives.com/), a while ago I just uploaded a pile of old ags games there to be sorted.

These uploaded missing games (and missing games that might be found again in the future) should at least be added to peders AGSA (there's space enough PLUS it's a dedicated space). Using a host like Mediafire isn't the best option imho...
I don't know if they can also be uploaded to the AGS games database somehow or linked from peder's AGSA?

Well, that stuff is up to AGA and Peder I think

Tramponline · Tue 21/05/2013 16:37:28

Yeah, I wasn't clear about that. Linking the AGS database entries to Peder's AGSA is basically what we did for the past two weeks (with a few minor exceptions that actually only have outside mirrors). If the missing game was in the AGSA database, we linked it there. I even pasted an AGSA link as download mirror in most entries while fixing screenshots. I meant exclusively those games that have no mirror at all so far, no AGSA entry (or file!), no outside mirror...
Means, how/where shall we store those game files until someone can upload those to the AGSA database?

arj0n · Tue 21/05/2013 16:45:39

Quote from: Tramponline on Tue 21/05/2013 16:37:28
Yeah, I wasn't clear about that. Linking the AGS database entries to Peder's AGSA is basically what we did for the past two weeks (with a few minor exceptions that actually have outside mirrors). If the missing game was in the AGSA database, we linked it there. I even pasted an AGSA link as download mirror in most entries while fixing screenshots.

Clear.

Quote from: Tramponline on Tue 21/05/2013 16:37:28
I meant exclusively those games that have no mirror at all so far, no AGSA entry (or file!), no outside mirror...

Isn't it easy for those games to upload them to their (maybe to be created) AGSA gamepage and add that AGSA-dl-link to the AGS-DB as main download link?
(just thinking...)

Leon · Tue 21/05/2013 17:20:01

Quote from: Arj0n on Tue 21/05/2013 16:45:39
Isn't it easy for those games to upload them to their (maybe to be created) AGSA gamepage and add that AGSA-dl-link to the AGS-DB as main download link?
(just thinking...)

That's what I've been saying all the time. Just check the games db to see if the link points to agsa download (not games page). If not, check if the game's available on agsa. If it is, change the link to point there, if it isn't and the games is elsewhere, create the page and download on agsa and point the games db to that direction.

That way you'll eventually filter out all the games you don't have and make the games available for the future.

arj0n · Tue 21/05/2013 18:12:03

Yes, sounds like the best way to work this all out.