Comprehensive comment stats

ReCreate · Post by **ReCreate** » Fri Jul 23, 2010 9:09 pm

(skip to stats if you just want to see the stats

)
A while ago I was working on a mobile version of the website(the root, the part that contains the comic itself, not the forums

), and it worked by parsing everything from the page, including comments and comment names.(etc) So I got an idea: make a crawler and log/save everything! So I did so. I made a relatively simple crawler that downloads each strip's page and parses and logs everything on it.(comments, comment dates, strip image, alt tip, title, etc) And wrote another little script to parse all the logged data(so to speak) and generate the following data:

STATS!

GRAPH! Number of comments per strip:

X = time/strip
Y = comments
As you can see, the number of comments per strip has skyrocketed recently.

In total, readers have made 34552 comments.
In the last month, people have made (approximately)6418 comments.
In the last month, the average number of comments per strip is (approximately)493.69230769231.(precision!

)
2624 different people have commented.
1099 people are one-time commenters and 52 people have commented 100 or more times.

Top 50 commenters:
1. Frank - 1540
2. Argent Stonecutter - 1495
3. FuRrY321 - 958
4. Valerio - 744
5. Thoth - 613
6. Gaboris - 515
7. Aerix "the Twilight" Spades - 506
8. BlueAnubis - 433
9. Dr. Prower - 394
10. Hopper200456 - 385
11. wingedwolfgirl - 360
12. Justice193 - 333
13. HonorèDerazey - 309
14. Spirit of the Wolf - 293
15. Fuzzypaws - 285
16. NobodyYouKnow - 280
17. Trefoiler - 274
18. Kamron - 266
19. psychoJoker36 - 246
20. sonic id furreh!!! - 237
21. rWolf1991 - 230
22. james319 - 223
23. Cerberus - 219
24. Snowmon - 187
25. valerio - 184
26. Rick Griffin - 171
27. Spirit Studios 2010 - 168
28. R-One - 167
29. Majin-Wolf - 164
30. Dissension - 164
31. GameCobra - 160
32. ReCreate(me!) - 154
33. The game - 152
34. Elwood Blutarsky - 151
35. Sleet - 147
36. CalaverX11 - 144
37. Zaiki - 130
38. Indagare - 118
39. D_Leo - 117
40. slacks315 - 116
41. Odos - 114
42. RageReaper - 113
43. Maxwell - 113
44. Val Kilmer Batman - 112
45. tahrey - 109
46. gagi - 107
47. Profesor Rod - 106
48. Inu225 - 106
49. Chip Uni - 104
50. IceKitsune - 102

(link to a text file with a list of all the commenters and how many times they've commented)
All-time top commenter: Frank
...whoever that is

Note: Data recorded on 7/19/2010(that's when the crawler collected all the data and the reason it took so long was because I procrastinated a lot and didn't get much time to work on the parsers >.>)
Note: ALL numbers are approximate, as the exact time of date when all data was collected was not logged.
Total time taken to crawl all the strips: aprox 30 minutes. Including downloading and parsing time.

Enjoy!

~ReCreate

edit: changed title to something less meh-ish

Zander · Post by **Zander** » Fri Jul 23, 2010 9:12 pm

ReCreate wrote:(link to a text file with a list of all the commenters and how many times they've commented)

This whole thing is epic, but wheres the link to that? :3

ReCreate · Post by **ReCreate** » Fri Jul 23, 2010 9:15 pm

Zander wrote:
ReCreate wrote:(link to a text file with a list of all the commenters and how many times they've commented)

This whole thing is epic, but wheres the link to that? :3

Whoops. XD Fixed. (post edited, check now)

Jimmy Jazz · Post by **Jimmy Jazz** » Fri Jul 23, 2010 9:31 pm

Wait.... I've commented three times?...

Huh....

ReCreate · Post by **ReCreate** » Fri Jul 23, 2010 9:38 pm

Jimmy Jazz wrote:Wait.... I've commented three times?...

Huh....

Under the name of "Jimmy Jazz"(case-sensitive), yes.

Jirodyne · Post by **Jirodyne** » Fri Jul 23, 2010 10:03 pm

ReCreate wrote:
Jimmy Jazz wrote:Wait.... I've commented three times?...

Huh....
Under the name of "Jimmy Jazz"(case-sensitive), yes. :P

I can tell it's case sensitive, You have two entries for me, under JiroDyne, and Jirodyne xD

ReCreate · Post by **ReCreate** » Fri Jul 23, 2010 10:08 pm

Jirodyne wrote:
ReCreate wrote:
Jimmy Jazz wrote:Wait.... I've commented three times?...

Huh....
Under the name of "Jimmy Jazz"(case-sensitive), yes.
I can tell it's case sensitive, You have two entries for me, under JiroDyne, and Jirodyne xD

Yeah, Just add the 2 of them up.

Recrawling and parsing everything, this time while being case-insensitive for a few entries isn't really worth it.

Dr. Prower · Post by **Dr. Prower** » Fri Jul 23, 2010 10:38 pm

WOOHOO! I'm #9!

FlintTheSquirrel · Post by **FlintTheSquirrel** » Fri Jul 23, 2010 11:14 pm

I am not even on the list. Yay!

Nice statistics by the way.

ReCreate · Post by **ReCreate** » Fri Jul 23, 2010 11:37 pm

Thanks.

Coding the parsers took some time, and generating the numbers was even longer and more frustrating. But it was worth it.

Typhon · Post by **Typhon** » Sat Jul 24, 2010 12:10 am

I don't usually comment on the comic. I save it for the forums.

fenning · Post by **fenning** » Sat Jul 24, 2010 12:12 am

Well now I'm just gonna try to comment as much as possible! HAHAHAHA!!!

valerio · Post by **valerio** » Sat Jul 24, 2010 2:05 am

wow! I'm 4th

Me approves of myself

ReCreate, I stay humble before you, you are the statwizard! All hail!

IceKitsune · Post by **IceKitsune** » Sat Jul 24, 2010 2:08 am

valerio wrote:wow! I'm 4th
Me approves of myself
ReCreate, I stay humble before you, you are the statwizard! All hail!

Yes Valerio, All hail ReCreate the Statwizard!

Really I can't believe I ranked 50th I thought I would be much lower then that.

ctcmjh · Post by **ctcmjh** » Sat Jul 24, 2010 2:10 am

2624 people have commented? My guess is that I am number 1450 lol

Buckdida · Post by **Buckdida** » Sat Jul 24, 2010 3:07 am

fenning wrote:Well now I'm just gonna try to comment as much as possible! HAHAHAHA!!!

I'll take note of that. I look forward to your constructive, thoughtful, and intellectual comments on the comic.

Mika · Post by **Mika** » Sat Jul 24, 2010 12:19 pm

Wow! im number 95!!!

ctcmjh · Post by **ctcmjh** » Sat Jul 24, 2010 12:21 pm

I'm actually 258? Awesome!

Typhon · Post by **Typhon** » Sat Jul 24, 2010 12:58 pm

If this Frank guy loves the comic so much he should join the forums lol

Liam · Post by **Liam** » Sat Jul 24, 2010 1:08 pm

He might be one of those non-forum preferers.

ReCreate · Post by **ReCreate** » Sat Jul 24, 2010 2:50 pm

fenning wrote:Well now I'm just gonna try to comment as much as possible! HAHAHAHA!!!

I don't plan on collecting all the stats again any time soon.

The stats aren't live, they're dated to the 19'th of this month. I may re-record stats in the distant future though.

Like, one year or so.

And by the way: I had done this all in PHP(on a borrowed laptop), using flot for the graph. Here's the source files if anyone wants it, though its rather messy and entirely undocumented.(it also contains the raw data that is logged by the crawler, which is included)

IceKitsune wrote:
valerio wrote:wow! I'm 4th
Me approves of myself
ReCreate, I stay humble before you, you are the statwizard! All hail!
Yes Valerio, All hail ReCreate the Statwizard! Really I can't believe I ranked 50th I thought I would be much lower then that.

lol XD stats wizard, though overlord would be more suitable.

I got the idea from gagi and his thread.

I'm thinking of making some comprehensive stats of the forum... like average posts per day by analyzing the dates of the posts, overall activity, etc?

Though crawling the entire forum would take quite a while, and I would probably have to remake a crawler in another language(php isn't really suitable) What do you guys think? Should I do it?

valerio · Post by **valerio** » Sat Jul 24, 2010 4:19 pm

most definitely, yes!
It would give the forum an even nicer touch of professionality.

The Game · Post by **The Game** » Sat Jul 24, 2010 7:13 pm

What? I'm 33!!

...
this must change...

gagi · Post by **gagi** » Sun Jul 25, 2010 7:28 am

sweet ...

i sort of did a simmilar thing just when i joined the formuz

https://www.housepetscomic.com/forums/v ... 91&p=57372

but i see you have put a bit more effort into it ....arff nice job ... and i never thought i would be on that list

hehe .. o well

yeyy for comments

funny stats would also be just to see how many comments got deleted ... and how those would effect the whole thing

arff

Ebly · Post by **Ebly** » Mon Jul 26, 2010 5:27 am

THINK OF THE RAMIFICATIONS

(Oh and Frank does have a forum account by the way, he's posted 25 times)

ReCreate · Post by **ReCreate** » Mon Jul 26, 2010 1:05 pm

Grats ebly, you just made a joke i didn't get.

Post by **Obbl** » Mon Jul 26, 2010 1:25 pm

I believe it's a correlation between the rise in the number of comments and the rise in the global temperature
THINK OF THE RAMIFICATIONS WHEN YOU POST COMMENTS, PEOPLE!!!

Sketcherofstuff · Post by **Sketcherofstuff** » Tue Jul 27, 2010 11:48 am

Odd, I could have sworn that I commented once, but I'm not on the list. Oh well, maybe I some how managed to screw it up

valerio · Post by **valerio** » Tue Jul 27, 2010 1:07 pm

Obbl wrote:I believe it's a correlation between the rise in the number of comments and the rise in the global temperature
THINK OF THE RAMIFICATIONS WHEN YOU POST COMMENTS, PEOPLE!!!

tsk tsk tsk, my dear: the only universally accepted correlation with the rising of global temperature is the ever-reducing presence of pirates, although the apparente increase in activity, recently, led to some weather instability toward cold.

Post by **Obbl** » Tue Jul 27, 2010 1:51 pm

valerio wrote:tsk tsk tsk, my dear: the only universally accepted correlation with the rising of global temperature is the ever-reducing presence of pirates, although the apparente increase in activity, recently, led to some weather instability toward cold.

Well, I never said it was MY belief.

Personally, I think it's all this dihydrogen oxide we've got floating about

Edit: Oh, and keeping on topic... I am number not-on-the-list! Wh00t!

sliceofdog · Post by **sliceofdog** » Tue Jul 27, 2010 4:00 pm

valerio wrote:
Obbl wrote:I believe it's a correlation between the rise in the number of comments and the rise in the global temperature
THINK OF THE RAMIFICATIONS WHEN YOU POST COMMENTS, PEOPLE!!!
tsk tsk tsk, my dear: the only universally accepted correlation with the rising of global temperature is the ever-reducing presence of pirates, although the apparente increase in activity, recently, led to some weather instability toward cold.

XD I wonder if you heard that theory from the same source as me. Might you be a Pastafarian?

Liam · Post by **Liam** » Tue Jul 27, 2010 7:07 pm

Ebly wrote:THINK OF THE RAMIFICATIONS

That's pseudo.scientific nonsense. As everybody knows the reason for global warming is the decrease in the number of pirates.

fenning · Post by **fenning** » Tue Jul 27, 2010 9:56 pm

Liam wrote:
Ebly wrote:THINK OF THE RAMIFICATIONS
That's pseudo.scientific nonsense. As everybody knows the reason for global warming is the decrease in the number of pirates.

Mmmmyes. Mmmpirate loss.

valerio · Post by **valerio** » Wed Jul 28, 2010 12:37 am

XD I wonder if you heard that theory from the same source as me. Might you be a Pastafarian?

And not the only one, methinks!
Hooray! Rahrr!

Liam · Post by **Liam** » Wed Jul 28, 2010 12:56 am

fenning wrote:
Liam wrote:
Ebly wrote:THINK OF THE RAMIFICATIONS
That's pseudo.scientific nonsense. As everybody knows the reason for global warming is the decrease in the number of pirates.
Mmmmyes. Mmmpirate loss.

It's science!

ReCreate · Post by **ReCreate** » Wed Jul 28, 2010 5:22 pm

Guys youre derailing the thread. >:c
*picks up thread and places on rails*
>.>

Frank · Post by **Frank** » Fri Jul 30, 2010 8:39 pm

Wow! This is amazing! I knew we had broken the record with Never Believe It’s Not So, but I hadn't imagined the tendancy to be like this. Did you go through all the pages taking the number, or is there some special software that can do that for you?

Also, I gues I do spend a lot of time commenting

I don't come to the forums as much because when I do, I feel obligated to check all the topics that have been updated in my absence; which from my past experiences on forums, I know can take hours

Typhon · Post by **Typhon** » Fri Jul 30, 2010 11:34 pm

Frank wrote:Wow! This is amazing! I knew we had broken the record with Never Believe It’s Not So, but I hadn't imagined the tendancy to be like this. Did you go through all the pages taking the number, or is there some special software that can do that for you?

Also, I gues I do spend a lot of time commenting I don't come to the forums as much because when I do, I feel obligated to check all the topics that have been updated in my absence; which from my past experiences on forums, I know can take hours

Hey, its Frank. Top commenter. Knew you were real and not an automated robot.

ReCreate · Post by **ReCreate** » Sat Jul 31, 2010 1:22 am

Frank wrote:Wow! This is amazing! I knew we had broken the record with Never Believe It’s Not So, but I hadn't imagined the tendancy to be like this. Did you go through all the pages taking the number, or is there some special software that can do that for you?

I made special sofware to automate it.

As explained in the first post. And lol, all hail the comment overlord!