Newegg Hard drive GB/$ Listing

[Sidoh]

Thought some of you might find this handy.

http://dark-wire.net/sidoh/NeweggGBPD/

Over the break, I might try to add some statistics to it (max, average, average this month, etc).

[iago]

That's pretty sweet, although I kinda worry that there are factors that aren't being taken into account. Still a great idea, though! Who wants to buy me a $90 1TB drive? :)

Can you do the same thing with external drives? I'm considering getting a new external.

[Sidoh]

Yeah, for sure.  There are other things you could consider.  The metric wouldn't be nearly as clean, though. :)

Yeah, you should be able to find an RSS feed for external hard drives.  Click the "x" next to the other feeds and paste the feed for external drives in the field there.  It should work.

400GB-750GB http://www.newegg.com/Product/RSS.aspx?Submit=ENE&N=2010150414%20131021357
800GB+ http://www.newegg.com/Product/RSS.aspx?Submit=ENE&N=2010150414%20131021336

[Quik]

Thought some of you might find this handy.

http://dark-wire.net/sidoh/NeweggBGPD/

Over the break, I might try to add some statistics to it (max, average, average this month, etc).

Good idea, I thought about the comparison of GB per dollar since the last time I went to Fry's and saw how cheap hard drives have gotten.

One thing though, shouldn't your link be /NeweggGBPD/ ?

[Sidoh]

haha, yes.  Either should work now.

[rabbit]

Any way to add drive rating?

[Sidoh]

I don't think they put the rating in their RSS feeds, so it'd be a matter of grabbing the page for every drive.  This thing caches the feeds (cache expires after an hour), so it's possible to do the same with the pages (or maybe even do some stuff with a database), but it'd make the initial load a lot slower.

A good idea might be to store the model number for every drive it sees and have a nightly job that grabs the page for every one or something.  That's something I can look into after break.

I'd be happy to post the source for this thing if anyone wants to mess around with it.

[rabbit]

There's got to be a way to get the ratings in the feed.......like some option somewhere?

[Sidoh]

There's got to be a way to get the ratings in the feed.......like some option somewhere?

I kind of doubt it.  RSS isn't that great -- it's just a commonly accepted standard.  There's really only fields for title, link, description and a few other things that are used less commonly.  If you want to look around for such an option on newegg (the little orange "RSS" button at the top of any search is where I'm getting these from), be my guest!  I'd be happy to incorporate that if it's easy to pull.

[Sidoh]

The source, if anyone is interested:

http://www.dark-wire.net/sidoh/NeweggGBPD/gbpd.tar.bz2

[Sidoh]

It appears that this has randomly started working again.  Woohoo! :D

[Sidoh]

(bump)

If anyone is interested in parsing the raw data for their own purposes, I made an xml feed:
http://www.dark-wire.net/sidoh/NeweggGBPD/xml.php
http://www.dark-wire.net/sidoh/NeweggGBPD/schema.xsd

I also have it collecting statistics every hour, and I'll try to get around to making some plots out of them sometime soon.

[Chavo]

I'm not using this right now or anything (though I have hit it a couple times), but a small suggestion:

<xs:element name="price" type="xs:string"/>
<xs:element name="capacity" type="xs:string"/>
<xs:element name="GBPD" type="xs:string"/>

Should really be decimal/integer/decimal for proper sorting imo

[Sidoh]

I'm not using this right now or anything (though I have hit it a couple times), but a small suggestion:

<xs:element name="price" type="xs:string"/>
<xs:element name="capacity" type="xs:string"/>
<xs:element name="GBPD" type="xs:string"/>

Should really be decimal/integer/decimal for proper sorting imo

Ah, great suggestion.  I felt like those should be float/int/float, but I didn't remember how to do that.  Fixed.  Thanks. :)

[Chavo]

No problem.

You missed though :D

<xs:element name="modelNumber" type="xs:string"/>
            <xs:element name="price" type="xs:string"/><!-- decimal -->
            <xs:element name="capacity" type="xs:decimal"/><!-- integer -->
            <xs:element name="GBPD" type="xs:integer"/><!-- decimal -->
            <xs:element name="productLink" type="xs:decimal"/><!-- string -->