Anyone know how big it is yet? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		fit2rule on July 11, 2015 \| parent \| context \| favorite \| on: A dataset of every Reddit comment Anyone know how big it is yet?

ihsw on July 11, 2015 | [–]

160GB.

One bz2 file of comments per month.

minimaxir on July 11, 2015 | [–]

Dataset on BigQuery is 265GB.

fit2rule on July 12, 2015 | [–]

I wasn't able to get access to it on BigQuery .. the progress bar just sat and sat .. can you confirm that its usable on BigQuery - I'd sure love to play with this data.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact