Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
neurotech1
on Aug 10, 2012
|
parent
|
context
|
favorite
| on:
How to crawl a quarter billion webpages in 40 hour...
Wouldn't the cost of transferring the crawled data (compressed/archived) to AWS/EC2 partially offset the cost saving?
Edit: AWS still has free imbound BW.. my bad
jdrock
on Aug 10, 2012
|
next
[–]
No - inbound data transfer cost to AWS is free.
brey
on Aug 10, 2012
|
prev
[–]
nice thing about running crawlers from EC2 - all inbound bandwidth is free
zerop
on Aug 11, 2012
|
parent
[–]
Like running crawlers what can be some other use cases where free inbound is a blessing?
bigiain
on Aug 11, 2012
|
root
|
parent
[–]
Backup/archive, where uploading data is frequent and downloading it is only very occasionally required.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
Edit: AWS still has free imbound BW.. my bad