GCN way to automatically verify dumps for wii

MarioMasta64

hi. i make batch stuff and portable shiz
OP
Member
Joined
Dec 21, 2016
Messages
2,297
Trophies
0
Age
26
Website
github.com
XP
2,106
Country
United States
is there any way i can automate the verification of gamecube and wii disc dumps in mass on a headless server by their id

example: my copy of pokemon xd gales of darkness is GXXE01

i do not want to use a gui and its preferred to be a linux tool (or even if theres an api i can use)

i found redump which is nice but i dont know any way to turn something like GXXE01 into http://redump.org/disc/1845/ do they have any kind of api?

basically all i need is any way to get the hash that the dump is supposed to be

ive also tried seeing if quick searching could help as a middle but it doesnt appear that you can search things this way http://redump.org/discs/quicksearch/gxxe01/
 

EnterpriseFreak

Well-Known Member
Newcomer
Joined
Sep 2, 2021
Messages
92
Trophies
0
Age
22
XP
1,020
Country
Germany
I don't know if it's good enough for you but I've made a bash script for that just now (needs wget and sha1sum commands):
https://pastebin.com/haribGkc

script.jpg
 

MarioMasta64

hi. i make batch stuff and portable shiz
OP
Member
Joined
Dec 21, 2016
Messages
2,297
Trophies
0
Age
26
Website
github.com
XP
2,106
Country
United States
im just doing this: redump_url=$(curl -Ls -o /dev/null -w %{url_effective} "http://redump.org/discs/quicksearch/$redump_code")

it would be nice if there was a way i could query this stuff directly

i did it this way after remembering that i had to also take off the versioning for images off of gametdb

i also save these hashes instead of just taking them everytime i go so that i dont have to bug the site owners with my requests (that much)

so i got it sorted out already but thank you anyways
I don't know if it's good enough for you but I've made a bash script for that just now (needs wget and sha1sum commands):
https://pastebin.com/haribGkc

View attachment 324843
 

MarioMasta64

hi. i make batch stuff and portable shiz
OP
Member
Joined
Dec 21, 2016
Messages
2,297
Trophies
0
Age
26
Website
github.com
XP
2,106
Country
United States
unfortunately while it works 95% of the time you sometimes have moments where it goes:
rlee (ah yes the garfield game and this wii game right!?" no no lol
this also applies to things with multiple versions
i wish you could sort by console or search only for the games code but it seems like the filters on the site are lackluster
 
Last edited by MarioMasta64,

Sypherone

Gaming Ninja
Member
GBAtemp Patron
Joined
Apr 28, 2019
Messages
1,659
Trophies
2
Age
44
XP
2,872
Country
Germany
Wii backup manager implies directly hash codes to verify the integrity of a wbfs image. So maybe they are stored already. So basicly it needs to be read out and the image can be verified.
An MD5 Hash is calculated and stored in each disc transferred to a drive, so it's possible to verify the data integrity at a later date. The hash isn't calculated for ISO yet.
 

MarioMasta64

hi. i make batch stuff and portable shiz
OP
Member
Joined
Dec 21, 2016
Messages
2,297
Trophies
0
Age
26
Website
github.com
XP
2,106
Country
United States
Wii backup manager implies directly hash codes to verify the integrity of a wbfs image. So maybe they are stored already. So basicly it needs to be read out and the image can be verified.
wii backup manager neither runs headless nor is it for linux it also doesnt check gamecube games so in all three ways it is useless to me
 

EnterpriseFreak

Well-Known Member
Newcomer
Joined
Sep 2, 2021
Messages
92
Trophies
0
Age
22
XP
1,020
Country
Germany
wii backup manager neither runs headless nor is it for linux it also doesnt check gamecube games so in all three ways it is useless to me
You could calculate the CRC32 or SHA-1 of the ISO first and then use that hash instead of the game code for /quicksearch/. Maybe that helps you?
 
  • Like
Reactions: MarioMasta64

MarioMasta64

hi. i make batch stuff and portable shiz
OP
Member
Joined
Dec 21, 2016
Messages
2,297
Trophies
0
Age
26
Website
github.com
XP
2,106
Country
United States
You could calculate the CRC32 or SHA-1 of the ISO first and then use that hash instead of the game code for /quicksearch/. Maybe that helps you?
maybe? the main issue is that crc/md5 calculations are really slow

i could use it and store the value for the first time then get it from the server and then use the gameid as a fallback but i want to be able to copy en masse before doing a check so that i can fix bugs if they arise without having to wait for verification for 5 years

i have like 300+ dumps and its unfeasable to do it this way when i do this in big amounts
 

MarioMasta64

hi. i make batch stuff and portable shiz
OP
Member
Joined
Dec 21, 2016
Messages
2,297
Trophies
0
Age
26
Website
github.com
XP
2,106
Country
United States
it does appear that it is a method i can use but its on the back burner since id want something faster than calculating the hash before checking
 

Attachments

  • 16617666714923352976065540185863.jpg
    16617666714923352976065540185863.jpg
    5.8 MB · Views: 31

MarioMasta64

hi. i make batch stuff and portable shiz
OP
Member
Joined
Dec 21, 2016
Messages
2,297
Trophies
0
Age
26
Website
github.com
XP
2,106
Country
United States
the main reason is that i cant wait around for 1500 minutes because it updates a user accessible resource that should be made beforehand the calculations are done afterhand
 

Attachments

  • 1661767173871540972544289059187.jpg
    1661767173871540972544289059187.jpg
    2.3 MB · Views: 24

Sypherone

Gaming Ninja
Member
GBAtemp Patron
Joined
Apr 28, 2019
Messages
1,659
Trophies
2
Age
44
XP
2,872
Country
Germany
I didnt have used or tryed them on my own. So sorry, u need to dig and try by yourself.
On the first look, with Wimms ISO Tool can be verified WII and GC ISO`S.
And with Wimms WBFS Tool can wbfs images be verified.
 
  • Like
Reactions: MarioMasta64

MarioMasta64

hi. i make batch stuff and portable shiz
OP
Member
Joined
Dec 21, 2016
Messages
2,297
Trophies
0
Age
26
Website
github.com
XP
2,106
Country
United States
I don't know if it's good enough for you but I've made a bash script for that just now (needs wget and sha1sum commands):
https://pastebin.com/haribGkc

View attachment 324843
so i decided to take a hybrid approach to this by calculating the md5 only when it cant normally find the page and then searching it with that

and while it adds a little bit of overhead it isnt as bad since i only have to do it once and its somewhat rare that it happens

i can also try and assume anything not found is likely a bad dump
 

Site & Scene News

Popular threads in this forum

General chit-chat
Help Users
  • T @ Texasauras:
    its on amazon
  • Psionic Roshambo @ Psionic Roshambo:
    Download Batocera make it your own
    +1
  • Psionic Roshambo @ Psionic Roshambo:
    If you want GC PS2 Wii stuff like that use a PC
    +1
  • Xdqwerty @ Xdqwerty:
    @Psionic Roshambo, i also use my tv stick to watch YouTube and streaming services
    +1
  • BigOnYa @ BigOnYa:
    Psi those play well on the Pi5 now...
  • BigOnYa @ BigOnYa:
    @Xdqwerty yep that's what I use my stick for most anymore, streaming tv shows, movies. or even youtube. Or doing kens mum.
    +1
  • K3Nv2 @ K3Nv2:
    RG Cube is going to be good for ps2 if it's $100
    +1
  • Xdqwerty @ Xdqwerty:
    @BigOnYa, and since the default emulator is below average i downloaded some "replacements" like snes9x for snes games for example
    +1
  • Xdqwerty @ Xdqwerty:
    And I also have my ps3
    +1
  • BigOnYa @ BigOnYa:
    Yea ps3 is a beast still to today compared to most "sticks"
  • K3Nv2 @ K3Nv2:
    If you just want pi for emulation no point when Anbernic releases new shit every two seconds
    +1
  • BigOnYa @ BigOnYa:
    What's really cool about Pi's tho is you can have multiple SD cards with different OS on each SD card and change from say a gaming machine to a full fledged pc if wanted
  • K3Nv2 @ K3Nv2:
    Plus all bios are set up and usually includes at least 128gbs or 64
  • K3Nv2 @ K3Nv2:
    Yeah but if your main goal is just to play n64 and GameCube you can save about $50 and have the portability option
    +1
  • BigOnYa @ BigOnYa:
    True, but on 2 monitors at 4k. Its just want you want really, to each they own.
  • K3Nv2 @ K3Nv2:
    For a kids aspect Anbernic would be the better option they'd probably melt over the price on a good 4k display
    +1
  • BigOnYa @ BigOnYa:
    For that texasroo guy, I'd recommend the Spell and speak as his first system.
    +1
  • K3Nv2 @ K3Nv2:
    So they buy a pi5 kit for about $150 and say a 28" 4k display probably looking around $400 total
  • K3Nv2 @ K3Nv2:
    They'll be getting in the territory of portable Pcs anyway
    +1
  • BigOnYa @ BigOnYa:
    Again you get what you pay for, its like buying a S series for $300 but its only 1440p native, if you want true 4k, gotta get the X model for $500. But yea you right, when moms buying it anyways, you gotta stay cheap.
  • K3Nv2 @ K3Nv2:
    They could use HD out on their TV no real need for a monitor these days tbh the purists will disagree
  • K3Nv2 @ K3Nv2:
    I'm kind of phasing out on the need for wanting all these consoles cool to have but they just become dust build ups
  • BigOnYa @ BigOnYa:
    I here ya there, I have too many myself, and have hard time letting them go, since most of mine I've modded at some point. Anymore I just play Switch on the go, seriesx at home.
  • Xdqwerty @ Xdqwerty:
    ack my throat
  • K3Nv2 @ K3Nv2:
    I need to invest in some storage tots tbh
    K3Nv2 @ K3Nv2: I need to invest in some storage tots tbh