« previous next »
Pages: [1] 2  All   Go Down

Author Topic: Newegg Hard drive GB/$ Listing  (Read 4850 times)

0 Members and 2 Guests are viewing this topic.

Offline Sidoh

  • x86
  • Hero Member
  • *****
  • Posts: 17634
  • MHNATY ~~~~~
    • View Profile
    • sidoh
Newegg Hard drive GB/$ Listing
« on: December 13, 2008, 01:24:09 pm »
Thought some of you might find this handy.

http://dark-wire.net/sidoh/NeweggGBPD/

Over the break, I might try to add some statistics to it (max, average, average this month, etc).
« Last Edit: December 13, 2008, 01:49:28 pm by Sidoh »
Logged

Offline iago

  • Leader
  • Administrator
  • Hero Member
  • *****
  • Posts: 17914
  • Fnord.
    • View Profile
    • SkullSecurity
Re: Newegg Hard drive GB/$ Listing
« Reply #1 on: December 13, 2008, 01:28:17 pm »
That's pretty sweet, although I kinda worry that there are factors that aren't being taken into account. Still a great idea, though! Who wants to buy me a $90 1TB drive? :)

Can you do the same thing with external drives? I'm considering getting a new external.
Logged

Offline Sidoh

  • x86
  • Hero Member
  • *****
  • Posts: 17634
  • MHNATY ~~~~~
    • View Profile
    • sidoh
Re: Newegg Hard drive GB/$ Listing
« Reply #2 on: December 13, 2008, 01:36:13 pm »
Yeah, for sure.  There are other things you could consider.  The metric wouldn't be nearly as clean, though. :)

Yeah, you should be able to find an RSS feed for external hard drives.  Click the "x" next to the other feeds and paste the feed for external drives in the field there.  It should work.

400GB-750GB http://www.newegg.com/Product/RSS.aspx?Submit=ENE&N=2010150414%20131021357
800GB+ http://www.newegg.com/Product/RSS.aspx?Submit=ENE&N=2010150414%20131021336
« Last Edit: December 13, 2008, 01:37:54 pm by Sidoh »
Logged

Offline Quik

  • Webmaster Guy
  • x86
  • Hero Member
  • *****
  • Posts: 3262
  • \x51 \x75 \x69 \x6B \x5B \x78 \x38 \x36 \x5D
    • View Profile
Re: Newegg Hard drive GB/$ Listing
« Reply #3 on: December 13, 2008, 01:47:35 pm »
Quote from: Sidoh on December 13, 2008, 01:24:09 pm
Thought some of you might find this handy.

http://dark-wire.net/sidoh/NeweggBGPD/

Over the break, I might try to add some statistics to it (max, average, average this month, etc).

Good idea, I thought about the comparison of GB per dollar since the last time I went to Fry's and saw how cheap hard drives have gotten.

One thing though, shouldn't your link be /NeweggGBPD/ ?
Logged
Quote
[20:21:13] xar: i was just thinking about the time iago came over here and we made this huge bomb and light up the sky for 6 min
[20:21:15] xar: that was funny

Offline Sidoh

  • x86
  • Hero Member
  • *****
  • Posts: 17634
  • MHNATY ~~~~~
    • View Profile
    • sidoh
Re: Newegg Hard drive GB/$ Listing
« Reply #4 on: December 13, 2008, 01:49:14 pm »
haha, yes.  Either should work now.
Logged

Offline rabbit

  • x86
  • Hero Member
  • *****
  • Posts: 8092
  • I speak for the entire clan (except Joe)
    • View Profile
Re: Newegg Hard drive GB/$ Listing
« Reply #5 on: December 13, 2008, 02:00:19 pm »
Any way to add drive rating?
Logged

Offline Sidoh

  • x86
  • Hero Member
  • *****
  • Posts: 17634
  • MHNATY ~~~~~
    • View Profile
    • sidoh
Re: Newegg Hard drive GB/$ Listing
« Reply #6 on: December 13, 2008, 02:48:07 pm »
I don't think they put the rating in their RSS feeds, so it'd be a matter of grabbing the page for every drive.  This thing caches the feeds (cache expires after an hour), so it's possible to do the same with the pages (or maybe even do some stuff with a database), but it'd make the initial load a lot slower.

A good idea might be to store the model number for every drive it sees and have a nightly job that grabs the page for every one or something.  That's something I can look into after break.

I'd be happy to post the source for this thing if anyone wants to mess around with it.
Logged

Offline rabbit

  • x86
  • Hero Member
  • *****
  • Posts: 8092
  • I speak for the entire clan (except Joe)
    • View Profile
Re: Newegg Hard drive GB/$ Listing
« Reply #7 on: December 13, 2008, 03:59:52 pm »
There's got to be a way to get the ratings in the feed.......like some option somewhere?
Logged

Offline Sidoh

  • x86
  • Hero Member
  • *****
  • Posts: 17634
  • MHNATY ~~~~~
    • View Profile
    • sidoh
Re: Newegg Hard drive GB/$ Listing
« Reply #8 on: December 13, 2008, 04:12:59 pm »
Quote from: rabbit on December 13, 2008, 03:59:52 pm
There's got to be a way to get the ratings in the feed.......like some option somewhere?

I kind of doubt it.  RSS isn't that great -- it's just a commonly accepted standard.  There's really only fields for title, link, description and a few other things that are used less commonly.  If you want to look around for such an option on newegg (the little orange "RSS" button at the top of any search is where I'm getting these from), be my guest!  I'd be happy to incorporate that if it's easy to pull.
Logged

Offline Sidoh

  • x86
  • Hero Member
  • *****
  • Posts: 17634
  • MHNATY ~~~~~
    • View Profile
    • sidoh
Re: Newegg Hard drive GB/$ Listing
« Reply #9 on: December 13, 2008, 06:41:27 pm »
The source, if anyone is interested:

http://www.dark-wire.net/sidoh/NeweggGBPD/gbpd.tar.bz2
Logged

Offline Sidoh

  • x86
  • Hero Member
  • *****
  • Posts: 17634
  • MHNATY ~~~~~
    • View Profile
    • sidoh
Re: Newegg Hard drive GB/$ Listing
« Reply #10 on: January 21, 2009, 01:30:43 pm »
It appears that this has randomly started working again.  Woohoo! :D
Logged

Offline Sidoh

  • x86
  • Hero Member
  • *****
  • Posts: 17634
  • MHNATY ~~~~~
    • View Profile
    • sidoh
Re: Newegg Hard drive GB/$ Listing
« Reply #11 on: September 30, 2009, 03:38:00 pm »
(bump)

If anyone is interested in parsing the raw data for their own purposes, I made an xml feed:
http://www.dark-wire.net/sidoh/NeweggGBPD/xml.php
http://www.dark-wire.net/sidoh/NeweggGBPD/schema.xsd

I also have it collecting statistics every hour, and I'll try to get around to making some plots out of them sometime soon.
Logged

Offline Chavo

  • x86
  • Hero Member
  • *****
  • Posts: 2219
  • no u
    • View Profile
    • Chavoland
Re: Newegg Hard drive GB/$ Listing
« Reply #12 on: September 30, 2009, 05:36:42 pm »
I'm not using this right now or anything (though I have hit it a couple times), but a small suggestion:
Quote
<xs:element name="price" type="xs:string"/>
<xs:element name="capacity" type="xs:string"/>
<xs:element name="GBPD" type="xs:string"/>
Should really be decimal/integer/decimal for proper sorting imo
Logged

Offline Sidoh

  • x86
  • Hero Member
  • *****
  • Posts: 17634
  • MHNATY ~~~~~
    • View Profile
    • sidoh
Re: Newegg Hard drive GB/$ Listing
« Reply #13 on: September 30, 2009, 06:08:02 pm »
Quote from: Chavo on September 30, 2009, 05:36:42 pm
I'm not using this right now or anything (though I have hit it a couple times), but a small suggestion:
Quote
<xs:element name="price" type="xs:string"/>
<xs:element name="capacity" type="xs:string"/>
<xs:element name="GBPD" type="xs:string"/>
Should really be decimal/integer/decimal for proper sorting imo

Ah, great suggestion.  I felt like those should be float/int/float, but I didn't remember how to do that.  Fixed.  Thanks. :)
Logged

Offline Chavo

  • x86
  • Hero Member
  • *****
  • Posts: 2219
  • no u
    • View Profile
    • Chavoland
Re: Newegg Hard drive GB/$ Listing
« Reply #14 on: September 30, 2009, 06:22:38 pm »
No problem.

You missed though :D
Quote
            <xs:element name="modelNumber" type="xs:string"/>
            <xs:element name="price" type="xs:string"/><!-- decimal -->
            <xs:element name="capacity" type="xs:decimal"/><!-- integer -->
            <xs:element name="GBPD" type="xs:integer"/><!-- decimal -->
            <xs:element name="productLink" type="xs:decimal"/><!-- string -->
Logged
Pages: [1] 2  All   Go Up
« previous next »