Issue 13555: cPickle MemoryError when loading large file (while pickle works) - Python tracker: "Well, replace cPickle by pickle and it works.
cPickle makes some direct call to malloc()/realloc()/free(), contrarily to pickle which uses pymalloc. This could lead to heap fragmentation."
'via Blog this'
Monday, September 30, 2013
divisi2/divisi2/fileIO.py at master · commonsense/divisi2 · GitHub
divisi2/divisi2/fileIO.py at master · commonsense/divisi2 · GitHub: "# If you run out of memory reading a gzip'ed file, un-gzip it first."
'via Blog this'
'via Blog this'
lshash 0.0.4dev : Python Package Index
lshash 0.0.4dev : Python Package Index: "LSHash depends on the following libraries:
numpy
redis (if persistency through Redis is needed)
bitarray (if hamming distance is used as distance function)
"
'via Blog this'
numpy
redis (if persistency through Redis is needed)
bitarray (if hamming distance is used as distance function)
"
'via Blog this'
Baby Steps - Algebra — Theano 0.6rc3 documentation
Baby Steps - Algebra — Theano 0.6rc3 documentation: ">>> import theano.tensor as T
>>> from theano import function
>>> x = T.dscalar('x')
>>> y = T.dscalar('y')
>>> z = x + y
>>> f = function([x, y], z)"
'via Blog this'
>>> from theano import function
>>> x = T.dscalar('x')
>>> y = T.dscalar('y')
>>> z = x + y
>>> f = function([x, y], z)"
'via Blog this'
Parallel | WestGrid
Parallel | WestGrid: "The GPUs are NVIDIA Tesla M2070s, each with about 5.5 GB of memory and what is known as Compute Capability 2.0 "
'via Blog this'
'via Blog this'
Parallel | WestGrid
Parallel | WestGrid: "60 special 12-core nodes that have 3 general-purpose GPUs each."
'via Blog this'
'via Blog this'
Sunday, September 29, 2013
Saturday, September 28, 2013
I²S - Wikipedia, the free encyclopedia
I²S - Wikipedia, the free encyclopedia: "I2S, also known as Inter-IC Sound, Integrated Interchip Sound, or IIS, is an electrical serial bus interface standard used for connecting digital audio devices together. It is used to communicate PCM audio data between integrated circuits in an electronic device. The I2S bus separates clock and serial data signals, resulting in a lower jitter than is typical of communications systems that recover the clock from the data stream."
'via Blog this'
'via Blog this'
Friday, September 27, 2013
How Google Converted Language Translation Into a Problem of Vector Space Mathematics | MIT Technology Review
How Google Converted Language Translation Into a Problem of Vector Space Mathematics | MIT Technology Review: "Having identified this mapping, it is then a simple matter to apply it to the bigger language spaces. Mikolov and co say it works remarkably well. “Despite its simplicity, our method is surprisingly effective: we can achieve almost 90% precision@5 for translation of words between English and Spanish,” they say."
'via Blog this'
'via Blog this'
Thursday, September 26, 2013
Lessons from Burning Man – Part 1 | N-DEO::Architecture
Lessons from Burning Man – Part 1 | N-DEO::Architecture: "The result of Toby and Michael’s efforts was the most comfortable environment I experienced on the Playa during mid day, with the exception of actually getting sprayed with a pressure washer from 10 yards away but that really isn’t practical in the desert."
Wednesday, September 25, 2013
1.3.5.11. Measures of Skewness and Kurtosis
1.3.5.11. Measures of Skewness and Kurtosis: "or univariate data Y1, Y2, ..., YN, the formula for skewness is:
"
'via Blog this'
"
'via Blog this'
1.3.5.11. Measures of Skewness and Kurtosis
1.3.5.11. Measures of Skewness and Kurtosis: "or univariate data Y1, Y2, ..., YN, the formula for skewness is:
"
'via Blog this'
"
'via Blog this'
Tuesday, September 24, 2013
weka - Making predictions
weka - Making predictions: "java weka.classifiers.trees.J48 -T unclassified.arff -l j48.model -p 0"
'via Blog this'
'via Blog this'
weka - Making predictions
weka - Making predictions: "Classifiers
After a model has been saved, one can make predictions for a test set, whether that set contains valid class values or not. The output will contain both the actual and predicted class. (Note that if the test class contains simply '?' for the class label for each instance, the "actual" class label for each instance will not contain useful information, but the predicted class label will.) The "-T " command-line switch specifies the dataset of instances whose classes are to be predicted, while the "-p " switch allows the user to write out a range of attributes (examples: "1-2" for the first and second attributes, or "0" for no attributes). Sample command line:
java weka.classifiers.trees.J48 -T unclassified.arff -l j48.model -p 0"
'via Blog this'
After a model has been saved, one can make predictions for a test set, whether that set contains valid class values or not. The output will contain both the actual and predicted class. (Note that if the test class contains simply '?' for the class label for each instance, the "actual" class label for each instance will not contain useful information, but the predicted class label will.) The "-T " command-line switch specifies the dataset of instances whose classes are to be predicted, while the "-p " switch allows the user to write out a range of attributes (examples: "1-2" for the first and second attributes, or "0" for no attributes). Sample command line:
java weka.classifiers.trees.J48 -T unclassified.arff -l j48.model -p 0"
'via Blog this'
weka - Saving and loading models
weka - Saving and loading models: "You save a trained classifier with the -d option (dumping), e.g.:
java weka.classifiers.trees.J48 -t /some/where/train.arff -d /other/place/j48.model
And you can load it with -l and use it on a test set, e.g.:
java weka.classifiers.trees.J48 -l /other/place/j48.model -T /some/where/test.arff"
'via Blog this'
java weka.classifiers.trees.J48 -t /some/where/train.arff -d /other/place/j48.model
And you can load it with -l and use it on a test set, e.g.:
java weka.classifiers.trees.J48 -l /other/place/j48.model -T /some/where/test.arff"
'via Blog this'
Monday, September 23, 2013
Mark Whittle: Big Bang Acoustics
Mark Whittle: Big Bang Acoustics: "It's quite a shock to find out that the sound spectrum of the early Universe is a bit like a vibrating object – it has a fundamental with harmonics!"
Sunday, September 22, 2013
Sif - Wikipedia, the free encyclopedia
Sif - Wikipedia, the free encyclopedia: "In Norse mythology, Sif is a goddess associated with earth. Sif is attested in the Poetic Edda, "
'via Blog this'
'via Blog this'
Friday, September 20, 2013
search - Ukkonen's suffix tree algorithm in plain English? - Stack Overflow
search - Ukkonen's suffix tree algorithm in plain English? - Stack Overflow: "The algorithm works in steps, from left to right. There is one step for every character of the string. Each step might involve more than one individual operation, but we will see (see the final observations at the end) that the total number of operations is O(n)."
'via Blog this'
'via Blog this'
Thursday, September 19, 2013
High Scalability - High Scalability - If You're Programming a Cell Phone Like a Server You're Doing it Wrong
High Scalability - High Scalability - If You're Programming a Cell Phone Like a Server You're Doing it Wrong: "Power on a cell phone is like water in a desert. It’s the very stuff of life. If you take the same naive programming techniques you learned when programming on a server in a datacenter your cell phone will die of thirst."
'via Blog this'
'via Blog this'
Wednesday, September 18, 2013
JASCO Research - Careers
JASCO Research - Careers: "JASCO always welcomes unsolicited resumés from qualified individuals. We are particularly interested in individuals with experience in marine biology, oceanography, physics, acoustics, optics, engineering or computer programming. Resumés from students seeking co-op terms or internships are welcome.
"
'via Blog this'
"
'via Blog this'
Plumbr – Why we dropped Eclipse in favour of IntelliJ
Plumbr – Why we dropped Eclipse in favour of IntelliJ: "For years, our friend Anton Arhipov has tried to convince us. He kept failing until he demoed something as simple as ALT+ENTER. Based on the documentation it is not doing much – just using the suggested quick fix. But this feature is backed by something that makes many other IntelliJ features so much more pleasing to use.
"
'via Blog this'
"
'via Blog this'
3D File Diffs
3D File Diffs: "Back in April, we introduced the 3D file viewer. Today we're improving this by displaying diffs of STL files on GitHub."
'via Blog this'
'via Blog this'
The $25 FPGA | Dr Dobb's
The $25 FPGA | Dr Dobb's: "However, Lattice seems to have taken this idea to the extreme. The iCEstick evaluation kit looks like a naked USB memory stick. Onboard is a fairly small FPGA, a USB interface chip, an IrDA transceiver, an oscillator, and a 32-megabit flash memory. There are also 5 LEDs, 16 digital I/O pins, and a PMOD port that can connect to many off-the-shelf modules from Digilent and a few other vendors."
'via Blog this'
'via Blog this'
A Pretty Good Work Day - Amir Rachum
A Pretty Good Work Day - Amir Rachum: "But our group leader (actually, his replacement) insisted that we give their way a chance. Not because their suggestion was good, but because it wasn’t just bad, it was dumber than a second coat of paint. It was so bad that it could not possibly work out for anyone. And that’s was he was counting on."
'via Blog this'
'via Blog this'
Tuesday, September 17, 2013
Don't use Hadoop - your data isn't that big
Don't use Hadoop - your data isn't that big: "Hadoop << SQL, Python Scripts
In terms of expressing your computations, Hadoop is strictly inferior to SQL. There is no computation you can write in Hadoop which you cannot write more easily in either SQL, or with a simple Python script that scans your files."
'via Blog this'
In terms of expressing your computations, Hadoop is strictly inferior to SQL. There is no computation you can write in Hadoop which you cannot write more easily in either SQL, or with a simple Python script that scans your files."
'via Blog this'
Five years ago, Stack Overflow launched. Then, a miracle occurred. « Blog – Stack Exchange
Five years ago, Stack Overflow launched. Then, a miracle occurred. « Blog – Stack Exchange: "Because here’s the crazy secret about gamification: In the history of the world, gamification has never gotten a single person do anything they didn’t already basically like to do."
'via Blog this'
'via Blog this'
Friday, September 13, 2013
IamA HTML5 Game Developer that just launched a kickstarter AMA! : IAmA
IamA HTML5 Game Developer that just launched a kickstarter AMA! : IAmA: "arrFoo[idx + 1]; // BAD
var idx1 = idx + 1;
arrFoo[idx1]; // GOOD
In a tight loop the "GOOD" option changes framerate from ~14 to ~60."
'via Blog this'
var idx1 = idx + 1;
arrFoo[idx1]; // GOOD
In a tight loop the "GOOD" option changes framerate from ~14 to ~60."
'via Blog this'
Thursday, September 12, 2013
python - Check if a given key already exists in a dictionary - Stack Overflow
python - Check if a given key already exists in a dictionary - Stack Overflow: "if 'key1' in dict.keys():
print "blah"
else:
print "boo""
'via Blog this'
print "blah"
else:
print "boo""
'via Blog this'
Prettt-tty, pretty, pretty good!: Actors are overly nondeterminstic
Prettt-tty, pretty, pretty good!: Actors are overly nondeterminstic: "Actors are overly nondeterminstic
Actors are useful as a low-level concurrency primitive, but as has been written elsewhere, they aren't the best high level programming model for writing concurrent programs."
'via Blog this'
Actors are useful as a low-level concurrency primitive, but as has been written elsewhere, they aren't the best high level programming model for writing concurrent programs."
'via Blog this'
rabexc: I/O performance in Python
rabexc: I/O performance in Python: "This file can get large, in the order of several hundreds of megabytes. The python code is trivial, given that each record is exactly the same size, but what is the fastest way to access and use that index file?"
'via Blog this'
'via Blog this'
Eloquent JavaScript Second Edition
Eloquent JavaScript Second Edition: "Eloquent JavaScript is an open, freely available textbook on JavaScript and computer programming in general. It was written in 2007 and has, since then, taught thousands of people, from Kashmir to Louisiana to Minas Gerais, to program."
'via Blog this'
'via Blog this'
Should You Commit Your Dependencies?
Should You Commit Your Dependencies?: "There are a few cases where you should never commit dependencies. When your code is a third-party component, when this code is registered as a dependency in other applications, then committing dependencies clearly doesn't work. Some dependencies require compilation, they are not portable. In this case, you can't commit them. Some dependencies, once installed, have very large elements. GitHub triggers a warning for files larger than 50MB. If you depend on a large .jar for instance, you're out of luck."
'via Blog this'
'via Blog this'
Game Programming Patterns / Optimizing Patterns / Dirty Flag
Game Programming Patterns / Optimizing Patterns / Dirty Flag: "Avoid unnecessary work by deferring it until the result is needed."
'via Blog this'
'via Blog this'
Two Scoops of Django: Best Practices for Django 1.5
Two Scoops of Django: Best Practices for Django 1.5: "We’ll introduce you to various tips, tricks, patterns, code snippets, and techniques that we’ve picked up over the years.
This book is great for:
Beginning Django developers.
Developers with intermediate to advanced knowledge of Django who want to improve their Django projects."
'via Blog this'
This book is great for:
Beginning Django developers.
Developers with intermediate to advanced knowledge of Django who want to improve their Django projects."
'via Blog this'
Wednesday, September 11, 2013
How even agile development couldn't keep this mega-project on track | ZDNet
How even agile development couldn't keep this mega-project on track | ZDNet: "Touted as the world's biggest agile software project, the £2.4bn Universal Credit programme was supposed to showcase how the software methodology could be used on a grand scale.
But two years after the project — intended to create an IT system that would underpin a major reform the UK welfare system — got under way, crack began to show as it ran over time and over budget.
According to a report by the government watchdog the NAO published last week, the UK government has had to write off at least £34m on the programme and delay the national launch for the project. The department in charge of the project, the Department for Work and Pensions (DWP), can't guarantee the remainder of the £303m it has spent on the project so far will offer "good value" it said.
"
'via Blog this'
But two years after the project — intended to create an IT system that would underpin a major reform the UK welfare system — got under way, crack began to show as it ran over time and over budget.
According to a report by the government watchdog the NAO published last week, the UK government has had to write off at least £34m on the programme and delay the national launch for the project. The department in charge of the project, the Department for Work and Pensions (DWP), can't guarantee the remainder of the £303m it has spent on the project so far will offer "good value" it said.
"
'via Blog this'
Tuesday, September 10, 2013
Turn On Your Damn Warnings | Twisted Oak Studios Blog
Turn On Your Damn Warnings | Twisted Oak Studios Blog: "Does your build environment have optional warnings? Turn them on. All of them. This has been said hundreds of times before, but I ran into lack-of-warnings problems in practice last week so I get to say it again."
'via Blog this'
'via Blog this'
Monday, September 09, 2013
Shiba Inu Puppy Cam, Ustream.TV: Tune in daily to see the cutest Shiba Inu pups… EVER! Ayumi's 2nd litter, the "E-Team", was born on August 21, 2013. The ...
How to spot first stories on Twitter using Storm | Michael Vogiatzis
How to spot first stories on Twitter using Storm | Michael Vogiatzis: "The interesting part in applying the LSH algorithm lies in the hash property. The fact that incoming tweets will be compared with only the tweets that have the same hash, as opposed to all previously seen ones is the beauty of it. It greatly reduces the comparisons required to find the closest neighbour."
'via Blog this'
'via Blog this'
Sunday, September 08, 2013
beta.sewreview.com - Blog and News: Fiber Optic Fabric
beta.sewreview.com - Blog and News: Fiber Optic Fabric: "This technology allows to wave plastic optical fibers alongside synthetic fibers, forming a luminous fabric. The luminous fabric is similar to a synthetic fabric (it can be sewn, hand washed,…), except that it can emit light when connected to a specific electronic module. This electronic module can be powered either by a disposable or rechargeable battery, or by a small mains transformer (for non wearable items).
Unlike standard optical fibers, the fiber optic fabric emits light along the full lenght of the fibers.
Unlike standard optical fibers, the fiber optic fabric emits light along the full lenght of the fibers.
Saturday, September 07, 2013
Tutorial - Submitting a job using qsub - High Performance Computing at NYU - NYU Wikis
Tutorial - Submitting a job using qsub - High Performance Computing at NYU - NYU Wikis: "All of our clusters have a batch server referred to as the cluster management server running on the headnode. "
'via Blog this'
'via Blog this'
Friday, September 06, 2013
Orcinus | WestGrid
Orcinus | WestGrid: "Phase One of the Orcinus cluster is comprised of 12 c7000 chassis, each containing 16 dual-density BL2x220 Generation 5 blades. There are 2 compute servers per blade (an A node, and a B node). Every node has 2 sockets, each containing an Intel Xeon E5450 quad-core processor, running at 3.0GHz"
'via Blog this'
'via Blog this'
Money Man Feeds Burning Man. Oy - Bloomberg
Money Man Feeds Burning Man. Oy - Bloomberg: ""We're airlifting in the challah again," said Steven Gluckstern, as he stood chatting recently with a few people. "Enough for 2,500 people," he added casually, taking a sip of his cocktail."
'via Blog this'
'via Blog this'
Wednesday, September 04, 2013
Permanently remove files and folders from a git repository
Permanently remove files and folders from a git repository: "git filter-branch --tree-filter 'rm -rf vendor/gems' HEAD
"
wtf
"
wtf
Tuesday, September 03, 2013
Passion M1
Passion M1: " open plan living/kitchen/dining area
- bedroom or sauna with extra sleeping area for 2
- 1 bathroom with toilet
- large sheltered terrace
- 2 fold-out beds for 2
- facade with stone cladding
- fully finished inside and outside
- ventilation and heating-cooling
- kitchen, furniture & home appliances included
- tripple class windows
- smart home system
- highly energy efficient
- eco-friendly materials"
- bedroom or sauna with extra sleeping area for 2
- 1 bathroom with toilet
- large sheltered terrace
- 2 fold-out beds for 2
- facade with stone cladding
- fully finished inside and outside
- ventilation and heating-cooling
- kitchen, furniture & home appliances included
- tripple class windows
- smart home system
- highly energy efficient
- eco-friendly materials"
Monday, September 02, 2013
ELAN description | The Language Archive
ELAN description | The Language Archive: "With ELAN a user can add an unlimited number of annotations to audio and/or video streams. An annotation can be a sentence, word or gloss, a comment, translation or a description of any feature observed in the media. Annotations can be created on multiple layers, called tiers. Tiers can be hierarchically interconnected. An annotation can either be time-aligned to the media or it can refer to other existing annotations. The textual content of annotations is always in Unicode and the transcription is stored in an XML format.
ELAN provides several different views on the annotations, each view is connected and synchronized to the media playhead."
'via Blog this'
ELAN provides several different views on the annotations, each view is connected and synchronized to the media playhead."
'via Blog this'
Subscribe to:
Posts (Atom)