Ref:Â http://stats.stackexchange.com/questions/18058/how-would-you-explain-covariance-to-someone-who-understands-only-the-mean Sometimes we can "augment knowledge" with an unusual or different approach. I would like this reply to be accessible to kindergartners and also have some fun, so everybody get out your crayons! Given paired (x,y)(x,y) data, draw their scatterplot. (The younger students may need a teacher to produce this for them. đź™‚ Each pair … Continue reading Intuitive Meaning of Covariance

# Add additional lib to Visual Studio project

Lib for VS contains: one .lib file, one .h header file. For Visual Studio you'll want to right click on your project in the solution explorer and then click on Properties. Next open Configuration Properties and then Linker. Now you want to add the folder you have the Allegro libraries in to Additional Library Directories, … Continue reading Add additional lib to Visual Studio project

# CUDA 5.0 and VS2012 Integration

Ref:Â http://blog.norture.com/2012/10/gpu-parallel-programming-in-vs2012-with-nvidia-cuda/ 1. Introduction Here I will share to you my first experience in creating a CUDA-based C++ program on Windows using Visual Studio 2012. CUDA is an acronym of Compute Unified Device Architecture, which is NVIDIAâ€™s general purpose computing API for their graphics card hardware. This simple program is taken from the example code of … Continue reading CUDA 5.0 and VS2012 Integration

# Standard Deviation: Why divided by (n-1) and not n?

Ref:Â http://mathcentral.uregina.ca/RR/database/RR.09.95/weston2.html Suppose that I am interested in the number of hours per day that high school students in North America spend doing their mathematics homework. The "population" of interest is all high school students in North America, a very large number of people. Lets call this number N. My real interest is the mean and … Continue reading Standard Deviation: Why divided by (n-1) and not n?

# Sense of PCA, eigenvectors & eigenvalues

Ref:Â http://stats.stackexchange.com/questions/2691/making-sense-of-principal-component-analysis-eigenvectors-eigenvalues Imagine a big family dinner, where everybody starts asking you about PCA. First you explain it to your great-grandmother; then to you grandmother; then to your mother; then to your wife; finally, to your daughter (who is a mathematician). Each time the next person is less of a layman. Here is how the conversation … Continue reading Sense of PCA, eigenvectors & eigenvalues

# Loss Functions: SVM vs. Softmax

Ref:Â http://cs231n.github.io/linear-classify/#svmvssoftmax A picture might help clarify the distinction between the Softmax and SVM classifiers: Example of the difference between the SVM and Softmax classifiers for one datapoint. In both cases we compute the same score vector f (e.g. by matrix multiplication in this section). The difference is in the interpretation of the scores in f: … Continue reading Loss Functions: SVM vs. Softmax

# Regularization

Means adding to loss function aÂ penalty term that penalizing large weights tends to improve generalization.