Discussion: Some Statistics

Envoyé par kpfitzgerald

Erasmus354 are you using the api? or screen scrape? it is a good idea not to delete data unless you know the data is corrupt in some way, if you are loading the data into a DB you can add a Boolean field to say whether the row is visible or not.

also the trasfers isnt that difficult if you write some simple logic or do a join then compare then add a true to the booloean field through an insert into...

key word being lazy imo

Envoyé par kpfitzgerald

Erasmus354 are you using the api? or screen scrape? it is a good idea not to delete data unless you know the data is corrupt in some way, if you are loading the data into a DB you can add a Boolean field to say whether the row is visible or not.

also the trasfers isnt that difficult if you write some simple logic or do a join then compare then add a true to the booloean field through an insert into...

Waaaaaaaaaaaaaayyyyyyyyyyyyyyy yyyyyyyyyy

over my head

See Spot.See Spot Run

There thats better

To Old Farts... Huzza!

ok... well if you want tell me a bit about what you are doing (specifically in a PM, don't want to create a security problem for you) and i may be able to help... is this pure hobby or do you have an interest in making this your vocation at some point if not already.

if you prefer your way then good job so far and good luck.

Dont mind me

Im not the guy who invented this

just a dopey Champ with nothing better to do than read these posts

and respond with sometimes witty retorts, sometimes not so witty

Envoyé par Erasmus354

Why should I delete data?

Perhaps I can modify it to leave inactive players off of the boards but let them show up in searches. I dunno ... I just don't like the idea of deleting data even though someone deleted their character. I want the site to act as a history.


As for transfers ... yea they aren't easy to deal with. I would have to every day go through every active player (like 150,000 of them) and check that against the full leaderboard scrape to see if they are still showing up. You can see how it gets unfeasible.

He DIDNT delete his char, he transferred to brandywine.

atm on your site, Faja shows up on Nimrodel and Brandywine.

Envoyé par kpfitzgerald

Erasmus354 are you using the api? or screen scrape? it is a good idea not to delete data unless you know the data is corrupt in some way, if you are loading the data into a DB you can add a Boolean field to say whether the row is visible or not.

also the transfers isn't that difficult if you write some simple logic or do a join then compare then add a true to the booloean field through an insert into...

The API wouldn't really work because you can't get a list of players from it. Unless I knew everyones name I couldn't use it. And while I do know most peoples names there are at least 20 new players each day. The only way right now is a screen scrape. The data is going into a mysql database (which currently has over 450,000 rows of data).


As for transfers, it is more than some simple logic. You have to recognize that the player doesn't exist on the old server, then find them on one of the new servers. In addition to that they may have gained an unknown amount of renown/infamy and changed their names. Sure for higher ranked players it is easier to do, but for lower ranked players it isn't so easy. The daily updates already take ~an hour, and will take more soon when I fully automate it (manual uploading a saved file is faster than doing the queries through a script, and I don't have CL access to the SQL server). LOTS more logic coupled with many more database queries in order to do that isn't worth the time on the daily updates or the time writing the script.

Nice to know.

Envoyé par Erasmus354

The API wouldn't really work because you can't get a list of players from it. Unless I knew everyones name I couldn't use it. And while I do know most peoples names there are at least 20 new players each day. The only way right now is a screen scrape. The data is going into a mysql database (which currently has over 450,000 rows of data).

bummer about the API... the data feed form that woudl be best... i just asked for a key waiting for a response.

Envoyé par Erasmus354

As for transfers, it is more than some simple logic. You have to recognize that the player doesn't exist on the old server, then find them on one of the new servers. In addition to that they may have gained an unknown amount of renown/infamy and changed their names. Sure for higher ranked players it is easier to do, but for lower ranked players it isn't so easy. The daily updates already take ~an hour, and will take more soon when I fully automate it (manual uploading a saved file is faster than doing the queries through a script, and I don't have CL access to the SQL server). LOTS more logic coupled with many more database queries in order to do that isn't worth the time on the daily updates or the time writing the script.

actually it is simple logic in SQL, several ways to skin that cat. you could do a join on the server tables looking for distincts based on a timestamp of last daily infany/renown gain. or do a select against all table for players making a temp table for insert into and comparing results and removing the duplicates.
450k rows may seem like a lot but it isnt in RDBMS standards. unless you are storing BLOB's or GLOB's....

I am a DBA so if you need assistance let me know.

Well pretty major setback it looks like for me. I think my main OS drive on my main PC kicked the bucket. This is a day after I finally automated the entire stat ripping process. Also, I don't have any backups of the stat ripping script. So I need to try and see if the HDD really did go up in flames or if I just need to repair the windows install while at the same time trying to get my 6 year old laptop setup with php and rewrite the entire stat ripping script from scratch before tomorrow morning ..... I also lost some improvements and additions to the site that I was working on.

Not a happy camper right now.

Envoyé par Erasmus354

Well pretty major setback it looks like for me. I think my main OS drive on my main PC kicked the bucket. This is a day after I finally automated the entire stat ripping process. Also, I don't have any backups of the stat ripping script. So I need to try and see if the HDD really did go up in flames or if I just need to repair the windows install while at the same time trying to get my 6 year old laptop setup with php and rewrite the entire stat ripping script from scratch before tomorrow morning ..... I also lost some improvements and additions to the site that I was working on.

Not a happy camper right now.

everyone give the man 20 bucks!

Everyone deserves one at some point!

Hooray for back pat kitteh!


The drive is dead, but it is still under warranty (WD Raptor 150). In the meantime I went down to Microcenter and picked up 2 WD640GB drives, one was bad, took that back, now I am trying to install Windows 7 onto a RAID array.

Is this not updating?

It's Monday here and the gains from Saturday aren't up yet...

I was looking forward to seeing my name at the top of the list for Saturday's gains (somewhere over 10,200)

Likewise - spent a good bit of time on my minstrel in the Moors this weekend, and the leaderboard shows me at 10k less than I have. It does show accrual from the weekend, but the numbers are wrong.

It also shows me as still be lvl 52, which is weird...

Envoyé par andulinde

Likewise - spent a good bit of time on my minstrel in the Moors this weekend, and the leaderboard shows me at 10k less than I have. It does show accrual from the weekend, but the numbers are wrong.

It also shows me as still be lvl 52, which is weird...

The level 52 thing is an issue with the old script only updating renown and rating figures and nothing else. The new one will solve this (in theory).

Also your gains from the blackout until when I get the new script done will be averaged across how many days it was. It is not a perfect solution but it's all I got.

Envoyé par operaoneyes

everyone give the man 20 bucks!

well I for one appreciate your unselfish commitment to all of our ego boosting stats (see Arks Post), send mail on your freep to me and Ill send you 1g for all your troubles

I guess it's actually gone for good =( sorry to hear about the OS problems and i guess the HD was not recoverable considering the absence of info. Your work is missed =)

Envoyé par Dommin-Nim

I guess it's actually gone for good =( sorry to hear about the OS problems and i guess the HD was not recoverable considering the absence of info. Your work is missed =)

Yeah rath only got in vent once recently and i didnt get around to asking him about leaderboards, so no update so far.

wow, reading the posts hurts my head, i didnt even get past pg 1 lol
n/a ftw

The day the music died: 5/9/09. RIP

Yea I totally agree.

I really dont know how accurate this can be. how does it take into consideration kinship changes, inactive subscriptions and transfered characters? The leading kin doesnt have a single member on the first page of the mylotro leaderboards for total server wide renown gain, nor the second or even at a glance that i saw third page, and with so few members there is no way that they could have that gain.

also, i know that honour and glory's total renown is more than 1.2mil or whatever that chart says, if that were the case over 1/4 of the kins renown would be mine, and honour and glory was an established pvp kin long before my coming along, and even with the transfer of faja, polar, who were some of our higher renown earners, the total is still higher than 1.2 mil. what i would like to see is a revised version of this to see which kin/tribe is earning the most renown/infamy on a day to day/week to week basis, rather than a total which is subject to so much change

So, is there any chance of this being resurrected? I loved the leaderboards and was sad to see them down a few months back.

Envoyé par masontamason

So, is there any chance of this being resurrected? I loved the leaderboards and was sad to see them down a few months back.

I'd say no.. those people have long left LotRO.

Envoyé par OGsam

I'd say no.. those people have long left LotRO.

Yeah, pretty sure Erath is playing WoW with some Legends people atm.

Envoyé par masontamason

So, is there any chance of this being resurrected? I loved the leaderboards and was sad to see them down a few months back.

I really doubt it. With upcoming games i don't think many will stick around to care enough, sadly. Leaderboards were always fun, it was the last thing servers could "compete at".

Pretty funny how it took a player to create something using the leaderboards that people would actually find fun and care about, turbines own leaderboards are lacklustre, buggy and now update pretty infrequently. RIP.

Envoyé par BLoNdiE

Yeah, pretty sure Erath is playing WoW with some Legends people atm.

I saw his hunter in the moors recently, but I didnt see him more than once.

Envoyé par ellestone

I saw his hunter in the moors recently, but I didnt see him more than once.

You're seeing things mr.star. Shrug, I haven't talked to him in weeks.

Envoyé par Erasmus354

UPDATED: http://leaderboard.awardspace.com/

Hey, this is pretty good...

Except for this. I dont believe it one bit

While Erasmus may be gone, the stats site isn't. It's been resurrected for the second time and the Nimrodel specific site is here

http://dailystats.theblackappendage....board/Nimrodel

Envoyé par aklouie

While Erasmus may be gone, the stats site isn't. It's been resurrected for the second time and the Nimrodel specific site is here

http://dailystats.theblackappendage....board/Nimrodel

Thank you, Vyxe.

Envoyé par aklouie

While Erasmus may be gone, the stats site isn't. It's been resurrected for the second time and the Nimrodel specific site is here

http://dailystats.theblackappendage....board/Nimrodel

But ofcourse, thank you Vyxe >.>

And I will not let Blondie have the last post for the next 5 months again lol

You are all cordially invited to the worlds largest Ettenmoors battle, which will take place July 17th on the server Belegaer.
Meet-up is at 7:30 pm (Central European time) in Gramsfoot. The monster tribe “die Boehsen Orkze” is looking forward to a large number of participants.
In case of questions, please visit the Orkze forum: http://boehseorkze.forumprofi.de/index.php