Replays (casted) database and "epic" matches
Replays (casted) database and "epic" matches
I have set up a replays database that lists Elite matches uploaded to YouTube with basic metadata and filtering options. Filtering by map, faction, hero etc. can be added if useful. The list is not complete yet yes it is, all Elite replays from the (major) channels are in. New casts are added within a few days as they go up.
One of the filtering options is "epic" which is a hall-of-fame type of thing, awarded to a match which is totally rad. I flagged one game so far. Suggestions for "epic" status can be posted in this thread.
http://www.dawnofwar.info/index.php?page=replays
One of the filtering options is "epic" which is a hall-of-fame type of thing, awarded to a match which is totally rad. I flagged one game so far. Suggestions for "epic" status can be posted in this thread.
http://www.dawnofwar.info/index.php?page=replays
Re: Replays (casted) database and "epic" matches
moar epic hammertime plz
http://www.youtube.com/watch?v=7IeQNESY7pw
http://www.youtube.com/watch?v=7IeQNESY7pw
><%FiSH((@>
Re: Replays (casted) database and "epic" matches
Reasonable suggestion, epic'd.
Re: Replays (casted) database and "epic" matches
Only through the destruction of our enemies do we earn our salvation.
Re: Replays (casted) database and "epic" matches
I updated the replay database this weekend after letting it fall behind for a few weeks and now we have reached 500 Elite replays over the three main YouTube channels (Dawn of War II Replays, Maestro Casts and FitzRupee Casts).
At the moment we are logging match date, title, map, duration, mod version and event (if it was part of a tournament or such, although this is not displayed yet) - but if someone has a real OCD with replays, we could save races/heroes as well (or even player names) in the database. However, all this is unavailable to any sort of automagic process so it would have to be entered manually. Hence the OCD... but if someone finds that interesting, contact me.
If there are other channels posting quality casts (HD video, good commentary) we can consider them for the database. YouTube would be easiest.
At the moment we are logging match date, title, map, duration, mod version and event (if it was part of a tournament or such, although this is not displayed yet) - but if someone has a real OCD with replays, we could save races/heroes as well (or even player names) in the database. However, all this is unavailable to any sort of automagic process so it would have to be entered manually. Hence the OCD... but if someone finds that interesting, contact me.
If there are other channels posting quality casts (HD video, good commentary) we can consider them for the database. YouTube would be easiest.
Re: Replays (casted) database and "epic" matches
I added functionality for filtering replays by map (use the 1v1, 2v2 and 3v3 buttons to filter 2p, 4p and 6p versions of maps like Calderis Refinery - this way the map list stays a bit shorter).
Re: Replays (casted) database and "epic" matches
I added an option to search/filter videos by event (e.g. tournament) although the filter selection area looks a bit stupid now. If there are games belonging to a tournament that were not flagged properly, let me know.
-
- Posts: 84
- Joined: Sat 27 Jul, 2013 3:51 pm
- Location: Germany
Re: Replays (casted) database and "epic" matches
Hi,
i don't know, if you have already seen it, but Eerie and me have set up a youtube channel for the monthly rumble tournaments, where i upload the games i have featured on my stream. Also Eerie wants to add some fancy stuff (later?).
Since you have a filter section for those tournaments, you might as well add those vids to your database.
Also you might want to add my stream to the streams list.
i don't know, if you have already seen it, but Eerie and me have set up a youtube channel for the monthly rumble tournaments, where i upload the games i have featured on my stream. Also Eerie wants to add some fancy stuff (later?).
Since you have a filter section for those tournaments, you might as well add those vids to your database.
Also you might want to add my stream to the streams list.
-
- Posts: 41
- Joined: Fri 14 Jun, 2013 3:57 pm
- Location: London
- Contact:
Re: Replays (casted) database and "epic" matches
http://www.youtube.com/channel/UCh8alfs0qCzKtkF-ihG4pog
my youtube channel, hit it for some humorous casts
my youtube channel, hit it for some humorous casts
Re: Replays (casted) database and "epic" matches
Awesome stuff; I have a lot of casts to catch up on so I will make good use of this.
Are the replays stored somewhere we can download them, or are all these directly submitted to the caster?
Are the replays stored somewhere we can download them, or are all these directly submitted to the caster?
My 1v1 map - Imperial Plaza. Revisions are in progress so please check it out and give feedback!
Re: Replays (casted) database and "epic" matches
Some go to casters, I guess some can be found on GR for example. There's no central archive for the actual replay files, although I still have all ranked 1v1 replays stored.
As for the replay database, I updated it with the Montly Rumble channel and Crazyman64335 and we now have more than 800 replays there.
As for the replay database, I updated it with the Montly Rumble channel and Crazyman64335 and we now have more than 800 replays there.
Re: Replays (casted) database and "epic" matches
Fixed some map search conditions bugging, fixed line breaks in the description text, and made better pagination links. Updated index, there's now 1087 videos in it.
Re: Replays (casted) database and "epic" matches
schwweeeeeeeeeettt. Dats a lot of vids man! Downtime viewing all set
-
- Posts: 7
- Joined: Mon 02 Jun, 2014 12:21 am
Re: Replays (casted) database and "epic" matches
Always thought this was one of the most epic casted replays:
https://www.youtube.com/watch?v=hHkqM1NhNok
https://www.youtube.com/watch?v=hHkqM1NhNok
- Adeptus Noobus
- Posts: 991
- Joined: Sat 15 Feb, 2014 12:47 pm
- Contact:
Re: Replays (casted) database and "epic" matches
Is there a way to filter the replays by factions? Sometimes I just want to find Space Marine replays or Eldar replays. Would be a feature/filter.
Re: Replays (casted) database and "epic" matches
It's easy to code BUT it would require someone to enter more metadata in the replays database. If there's a volunteer for that (go through 1000+ reps and input hero for each player) then np I'll code it for you.
- Adeptus Noobus
- Posts: 991
- Joined: Sat 15 Feb, 2014 12:47 pm
- Contact:
Re: Replays (casted) database and "epic" matches
I get what you mean. Would it create a conflict if only future replays would contain these new metadata. If yes, could not all old videos be simply linked to all factions, saving the time to put them all into the right factions.
Another possibility would be me going through these videos if you give me a list I can work with.
Another possibility would be me going through these videos if you give me a list I can work with.
Re: Replays (casted) database and "epic" matches
That is essentially what Lulgrim said, if someone is willing to categorise the old replays by faction he can code the tool for it so someone can reorganise them all.
The internal battery has run dry, the game can now be played. However, clock based events will no longer occur.
Re: Replays (casted) database and "epic" matches
No replay files, sadly
When in mortal danger, when beset by doubt
Run in little circles, wave your hands and shout
Run in little circles, wave your hands and shout
- Adeptus Noobus
- Posts: 991
- Joined: Sat 15 Feb, 2014 12:47 pm
- Contact:
Re: Replays (casted) database and "epic" matches
Ok, I have found the time to look into this and Unix is actually (as usual) quite powerful for this problem.
I do not know the folder structure of the database in which the replay files are saved but here it goes:
This will print out a list of all the factions that were involved in the match. Each faction also only occurs once to avoid doubles etc. This would be troublesome if the replay were for example from a faction war.
The output looks as follows (in the case of my replay file):
Notice how the number of factions does not add up to 6, as multiple occurrences have been filtered out.
If however you wanted the full list in order of the players appearance, use this code instead:
From here on, I believe it is very easy to copy each replay file into a faction-specific folder or something alike, to seperate the replays by faction.
I hope this helps.
EDIT:
The color schemes could be extracted in the same way if wanted. The players names however are more difficult to extract as Relic has chosen to code them in a rather funny way: not as a string but as sequences of letters divided by decimal points making it more difficult to extract them from the data mumbo jumbo.
I do not know the folder structure of the database in which the replay files are saved but here it goes:
Code: Select all
strings 6p_garvusicegate.2014-11-21.02-10-47.rec | grep -A1 DATAINFO | sed s/DATAINFO//g | sed "s/[^a-z]//g" | grep -v data | sort | uniq
This will print out a list of all the factions that were involved in the match. Each faction also only occurs once to avoid doubles etc. This would be troublesome if the replay were for example from a faction war.
The output looks as follows (in the case of my replay file):
Code: Select all
chaosmarines
eldar
imperialguard
spacemarines
Notice how the number of factions does not add up to 6, as multiple occurrences have been filtered out.
If however you wanted the full list in order of the players appearance, use this code instead:
Code: Select all
strings 6p_garvusicegate.2014-11-21.02-10-47.rec | grep -A1 DATAINFO | sed s/DATAINFO//g | sed "s/[^a-z]//g" | egrep -v "data|^$"
chaosmarines
spacemarines
spacemarines
eldar
imperialguard
chaosmarines
From here on, I believe it is very easy to copy each replay file into a faction-specific folder or something alike, to seperate the replays by faction.
I hope this helps.
EDIT:
The color schemes could be extracted in the same way if wanted. The players names however are more difficult to extract as Relic has chosen to code them in a rather funny way: not as a string but as sequences of letters divided by decimal points making it more difficult to extract them from the data mumbo jumbo.
- Adeptus Noobus
- Posts: 991
- Joined: Sat 15 Feb, 2014 12:47 pm
- Contact:
Re: Replays (casted) database and "epic" matches
OK, after having conferred with the dark gods of coding (more bytes to the byte throne) I may have come up with a solution:
The code dumps the header of the replay file -> Extracts the neccessary lines containing the information -> formats the output and voilá we have the race AND the player name.
This code has been tested on a MacBook under Mac OSX. The syntax may be slightly different for other unix systems.
But there you have it, a way to automatically extract the player names and the corresponding races. Sadly the heroes used are not coded in clear text, so that I can not (yet) account for them in the code.
Any feedback would be greatly appreciated.
EDIT
The last two characters in Corteaz' name are the result of him using special characters in his username. Unfortunately I can not yet convert these. I would have to account for every special character there is, which quite frankly, I dont want to do.
Code: Select all
hexdump -v -e '/2500 "%010_ad |"' -e '2500/1 "%_p" "|\n"' 6p_garvusicegate.2014-11-21.02-10-47.rec | sed $'s/DATAINFO/\\\nDATAINFO/g' | sed -n 's/.*DATAINFO\(.*data\).*/\1/p' | perl -pe 's/(\.\.\.\.)+/\|/g; s/^\|//g;s/\.//g' | perl -lne ' @A = split(/\|/,$_) ; $A[1] =~ s/[^a-z]//g; print "$A[0]|$A[1]" if $A[1]'
Twitchtv/Corteaz"!|chaosmarines
sk4zi|spacemarines
Adeptus Noobus|spacemarines
Ar-Aamon|eldar
TehMuffinman571|imperialguard
Lupercal|chaosmarines
The code dumps the header of the replay file -> Extracts the neccessary lines containing the information -> formats the output and voilá we have the race AND the player name.
This code has been tested on a MacBook under Mac OSX. The syntax may be slightly different for other unix systems.
But there you have it, a way to automatically extract the player names and the corresponding races. Sadly the heroes used are not coded in clear text, so that I can not (yet) account for them in the code.
Any feedback would be greatly appreciated.
EDIT
The last two characters in Corteaz' name are the result of him using special characters in his username. Unfortunately I can not yet convert these. I would have to account for every special character there is, which quite frankly, I dont want to do.
Last edited by Adeptus Noobus on Tue 23 Dec, 2014 1:11 pm, edited 1 time in total.
Re: Replays (casted) database and "epic" matches
Just a really general question but is there some way we can implement an upload feature? I imagine it looking like a simple "insert file ->" upload and then it'll ask you to fill in details manually for you such as:
1v1/2v2/3v3
Factions used
Map
Description
etc etc
Yes, I'm essentially asking for a gamereplays.net specific to the site for Elite and people can just up/down load stuff from here.
1v1/2v2/3v3
Factions used
Map
Description
etc etc
Yes, I'm essentially asking for a gamereplays.net specific to the site for Elite and people can just up/down load stuff from here.
- Adeptus Noobus
- Posts: 991
- Joined: Sat 15 Feb, 2014 12:47 pm
- Contact:
Re: Replays (casted) database and "epic" matches
Is this still of any interest to you Fulgrim?
Re: Replays (casted) database and "epic" matches
Barrogh wrote:No replay files, sadly
Idd, this would require the actual replay files from each cast Unless the casters have been super organized and stored the reply file or relevant data with the corresponding casted video, this is gonna require some major manual work.
Gotta love that unix-fu though.
edit: looks like at least Indrid writes down races/heroes in the video description so we could easily add this data to the db.
- Adeptus Noobus
- Posts: 991
- Joined: Sat 15 Feb, 2014 12:47 pm
- Contact:
Re: Replays (casted) database and "epic" matches
I always thought that all the replay files were actually uploaded here. Now I understand what Fulgrim ment when he said it had to be done manually. Well if you consider adding a upload feature (like Atlas asked) to this site where people can simply upload their replays, you could use this script to extract all the data automatically (in addition to the info that you already extract i.d. chat transcript etc.) and wipe the files afterwards. This would make keeping the ranked list up-to-date pretty easy. Just an idea.
Re: Replays (casted) database and "epic" matches
Adeptus Noobus wrote:Well if you consider adding a upload feature (like Atlas asked) to this site where people can simply upload their replays, you could use this script to extract all the data automatically (in addition to the info that you already extract i.d. chat transcript etc.) and wipe the files afterwards. This would make keeping the ranked list up-to-date pretty easy. Just an idea.
It's a lot better than having 1 guy fill in the data but I doubt ppl will bother with this. The only acceptable solution is a automatic one I think.
Anyway I've made the Replay db able to self-update and I also made it parse players, heroes and map played from youtube but it will only work if casters fill this out (in rather consistent format). Torpid's channel was also added but please add the map in description
Basically all this effort in order to easily find casts with certain MU's, see http://dawnofwar.info/index.php?page=replays. Note older replays have not been fully indexed.
Re: Replays (casted) database and "epic" matches
Pretty amazing bro, ty!
- Adeptus Noobus
- Posts: 991
- Joined: Sat 15 Feb, 2014 12:47 pm
- Contact:
Re: Replays (casted) database and "epic" matches
This is awesome. Maybe we should make all the casters aware of this format of yours so that they abide by it.
Re: Replays (casted) database and "epic" matches
No special format needed but it be nice if they kept it consistent, that way I don't have to update the reg-ex filters. I've indexed most of the replays now, but many will be missing data because there war errors parsing it or it just wasn't entered in the title/description.
- Adeptus Noobus
- Posts: 991
- Joined: Sat 15 Feb, 2014 12:47 pm
- Contact:
Re: Replays (casted) database and "epic" matches
We have had quite a few tournaments since the last update to the ratings. Is there any way that we could access the ratings part of the site to update them? (Yes, I will do it, if you show me where I can do it)
The ideas we were throwing around to actually make changes to the replay files to include all the neccessary data did not bear any fruits so far I guess, because of the lack of programmers who actually have time to do so?
The ideas we were throwing around to actually make changes to the replay files to include all the neccessary data did not bear any fruits so far I guess, because of the lack of programmers who actually have time to do so?
Who is online
Users browsing this forum: No registered users and 12 guests