Newton Institute Seminar : van Houwelingen, JC, 17/06/2008

Newton Institute Seminar : van Houwelingen, JC, 17/06/2008: "Global testing of association and/or predictability in regression problems with p>>n predictors"

'via Blog this'

Logistic

Logistic: "
In order to find the matrix B for which L is minimised, a Quasi-Newton Method is used to search for the optimized values of the m*(k-1) variables. Note that before we use the optimization procedure, we 'squeeze' the matrix B into a m*(k-1) vector. For details of the optimization procedure, please check weka.core.Optimization class.

Although original Logistic Regression does not deal with instance weights, we modify the algorithm a little bit to handle the instance weights.

For more information see:

le Cessie, S., van Houwelingen, J.C. (1992). Ridge Estimators in Logistic Regression. Applied Statistics. 41(1):191-201."

'via Blog this'

Logistic Regression

Logistic Regression: "Logistic Regression (SGD)
Logistic regression is a model used for prediction of the probability of occurrence of an event. It makes use of several predictor variables that may be either numerical or categories.

Logistic regression is the standard industry workhorse that underlies many production fraud detection and advertising quality and targeting products. The Mahout implementation uses Stochastic Gradient Descent (SGD) to all large training sets to be used.

For a more detailed analysis of the approach, have a look at the thesis of Paul Komarek:

http://www.autonlab.org/autonweb/14709/version/4/part/5/data/komarek:lr_thesis.pdf?branch=main&language=en

See MAHOUT-228 for the main JIRA issue for SGD.

"

'via Blog this'

Logistic

Logistic: "Class for building and using a multinomial logistic regression model with a ridge estimator.

There are some modifications, however, compared to the paper of leCessie and van Houwelingen(1992):

If there are k classes for n instances with m attributes, the parameter matrix B to be calculated will be an m*(k-1) matrix.
"

'via Blog this'

Bootswatch: Free themes for Twitter Bootstrap

Bootswatch: Free themes for Twitter Bootstrap:

'via Blog this'

WEKA - Convert from arff to csv from command line?

WEKA - Convert from arff to csv from command line?: " weka.core.converters.CSVSaver -i -o "

'via Blog this'


java -Xmx1500m -classpath /usr/share/java/weka.jar weka.core.converters.CSVSaver -i test.arff -o test.csv

Getting Started

Getting Started: "/* local mode */
$ pig -x local ...


/* mapreduce mode */
$ pig ...
or
$ pig -x mapreduce ..."

'via Blog this'

Meet the inverse of Susan Boyle: France’s young heavy metal singer - Salon.com

Meet the inverse of Susan Boyle: France’s young heavy metal singer - Salon.com:

'via Blog this'

'via Blog this'

Performing Data Science with HBase: Strata Conference + Hadoop World - O'Reilly Conferences, October 23 - 25, 2012, New York, NY

Performing Data Science with HBase: Strata Conference + Hadoop World - O'Reilly Conferences, October 23 - 25, 2012, New York, NY: "Regardless, large amounts of data – especially data about users intended for use in an online system such as an e-commerce site, gaming platform, or ad network – is stored in HBase, and data scientists must be able to perform investigative analysis on this information to better understand their business and improve these online processes. And the read/write model of HBase offers advantages over HDFS to the data scientist building complex analysis pipelines."

'via Blog this'

Software Engineer, Data Infrastructure Engineering | Facebook Careers

Software Engineer, Data Infrastructure Engineering | Facebook Careers: "Facebook is seeking a Software Engineer to join the Data team. The ideal candidate will dream about distributed systems for the parallel processing of massive quantities of data, be familiar with Hadoop/Pig/HBase and MapReduce/Sawzall/Bigtable, and frequently think to themselves, 'Yeah, that works for 500 MB of data; what about 500 TB?' This position is full-time and based in our New York office."

'via Blog this'

NetInfo Manager - Wikipedia, the free encyclopedia

NetInfo Manager - Wikipedia, the free encyclopedia: "Methods for editing users attributes on Mac OS X Leopard (user shell, uid, primary gid, home directory path)

command line: dscl (Panther, Tiger, Leopard)
System Preferences:Accounts Pane – unlock the accounts pane – right-click/control-click on a user account – pop-up menu "advanced" – this panel will let you edit user attributes.
Note: you may need to reboot after changing this sort of information, or run 'dscacheutil -flushcache' from the command line."

'via Blog this'

The Gorburger Show: Tegan and Sara [Episode 1] - YouTube

The Gorburger Show: Tegan and Sara [Episode 1] - YouTube: ""

'via Blog this'

Why is Mahout necessary? | LinkedIn

Why is Mahout necessary? | LinkedIn: "Vishwakarma S. • We can understand the value of Mahout by following these two approaches of machine learning. One approach would be to collect, clean, and then use all the data to learn a model using an algorithm in Mahout. This approach does not yield a good result because real data is always dirty ( noise, skewed, missing values, error, correlated, etc.). Generally, ML is a two step process : Data Preprocessing and Model Learning. "

'via Blog this'

Why is Mahout necessary? | LinkedIn

Why is Mahout necessary? | LinkedIn: "Raphael C. • The 'Mining Massive Data Sets' course at Stanford is also pretty good.
"

'via Blog this'

Jingle Bells - Wikipedia, the free encyclopedia

Jingle Bells - Wikipedia, the free encyclopedia: "Now the ground is white
Go it while you're young,
Take the girls tonight
and sing this sleighing song;"

'via Blog this'

How to record audio in Chrome with native HTML5 APIs

How to record audio in Chrome with native HTML5 APIs: "This happened right in the middle of our efforts to build the Dubjoy Editor, a browser-based, easy to use tool for translating (dubbing) online videos. Relying on Flash for audio recording was our first choice, but when confronted with this devastating issue, we started looking into other options. Using native HTML5 APIs seemed like a viable solution.

"

'via Blog this'

Hadoop Tutorial - YDN

Hadoop Tutorial - YDN:

'via Blog this'

Map/Reduce Tutorial

Map/Reduce Tutorial: "Although the Hadoop framework is implemented in JavaTM, Map/Reduce applications need not be written in Java.

Hadoop Streaming is a utility which allows users to create and run jobs with any executables (e.g. shell utilities) as the mapper and/or the reducer.
Hadoop Pipes is a SWIG- compatible C++ API to implement Map/Reduce applications (non JNITM based)."

'via Blog this'

Writing An Hadoop MapReduce Program In Python @ Michael G. Noll

Writing An Hadoop MapReduce Program In Python @ Michael G. Noll: "Precisely, we compute the sum of a word’s occurrences, e.g. (“foo”, 4), only if by chance the same word (“foo”) appears multiple times in succession. In the majority of cases, however, we let the Hadoop group the (key, value) pairs between the Map and the Reduce step because Hadoop is more efficient in this regard than our simple Python scripts."

'via Blog this'