On the Future of Data Science

“Each [Kaggle] contest has generated a better model for its data than what was used beforehand.” (Science)

No snake-oil. no bullshit.

Jeremy Howard’s talk at O’Reilly’s StrataConf New York is now up online.  The talk outlines Jeremy’s vision for Kaggle and the future of data science.

Following up on my previous post on scientific crowdsourcing it is really interesting to see where they are taking this – I myself got the “bug” when participating in the IJCNN social network contest. By using relatively simple network-internal descriptors (i.e. common neighbours in the 1st and 2nd shell) I landed somewhere in the mid-field. The top-scorers used de-anonymizing the network and crawling flickr – such options didn’t even cross my mind. So I learned something from the winning strategies by reading up on the papers and blog entries on the methods they employed – as described in this talk. On the one hand it demonstrates the power of mapping networks for computational inference, on the other hand it also taught me to sometimes think “outside” the given data. Needless to say, I like to look at things from a different angle – so its nice to see it working as a way of scientific discovery for others as well.

see also this special on ABC catalyst.

Advertisements

, , ,

  1. #1 by cistronic on 2011/12/15 - 04:12

    see also “Accidental Scientist Hawks ‘Online Marketplace for Brains’” on wired
    http://www.wired.com/wiredenterprise/2011/12/kaggle/

  2. #2 by cistronic on 2012/01/05 - 13:30

    more on “The year in big data and data science” by by Audrey Watters on O’Reilly radar:
    http://radar.oreilly.com/2011/12/big-data-data-science-2011.html
    The entire list of Strata2011 youtube-videos is available at
    youtube.com/view_play_list?p=EF277D84FE2A28D5

    The most-watched one is Hilary Mason on “What Data Tells Us”

further hints, constructive criticism, questions, praise

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: