# Blogs

### TF

The practice is to understand how Tensorflow applied to shadow NN in MNIST data. The practice is from Big Data University lectures. Reference: Support_Vector_Machines.html (Coursera Machine Learning Course) Big Data University TensorFlow course Deep Learning Concept Using multiple process layer with non-linear algorithm to simulate brain ability; A branch of machine learning. We will focus on shadow NN in this note. Shadow NN MNIST Example: two or three layers only. In the context of supervised learning, digits recognition in our case, the learning consists of a target/feature which is toRead More

......This Note is for image texture explanation: Reference https://courses.cs.washington.edu/courses/cse576/book/ch7.pdf (computer vision) Why Texture Texture gives us information about the spatial arrangement of the colors or intensities in an image. Why? The answer is the histogram can’t fully represent/classify images. All images below are half white and half black. However, the images are different. How to recognize texture Structural approach: Texture is a set of primitive texels in some regular or repeated relationship. Statistical approach: Texture is a quantitative measure of the arrangement of intensities in a region. Statistical method Co-occurrenceRead More

......The note is to understand the concept/rise of CNN. Reference: http://colah.github.io/posts/2014-07-Conv-Nets-Modular/ Introduction convolutional neural network Lot’s of same neurons, similar as java function, which can be re-use X is the input layer (you can sense that is see/hear/smell, etc. for example, image, video, audio, document) Next Layer is not always fully connected with previous layer: one neuron of type A neuron is not fully connected to each X. B is not fully connected with All A F is fully connected with all B Why so many same neurons? ThatRead More

......The note is to describe how to calculate Convolution via manual or TensorFlow command. TensorFlow convolution common commands: y= np.convolve(x,h,”valid”) and y= np.convolve(h,x,”valid”) are same…also true for “same”,”full” options. from scipy import signal as sg sg.convolve is using FFT which is faster than np.convolve for big matrix convolution inverse = numpy.linalg.inv(x) One dimension with zero padding When we apply kernel, we always use kernel’s inverse to multiply and sum. One dimension without zero padding One dimension filter with multiple dimensions of input x= [[255, 7, 3], Read More

......The note intention is to understand the word2vec, and how to build a small NN to start your adventure on Deep Learning. You can see many source codes here to build the NN. But I am not yet built it with TF. Reference: A visual toy NN network for word2vec generation. The whole source code is from https://ronxin.github.io/wevi/. The source code is written by javascript for NN with html and svg (https://www.tutorialspoint.com/d3js/d3js_introduction_to_svg.htm) for graph visibility. Try your best to understand all thoroughly (not just well enough). It will help youRead More

......### Dos

Tools/Reference used for the project: dosbox debug: http://www.vogons.org/viewtopic.php?t=394 http://www.vcfed.org/forum/showthread.php?11320-NE2000-card-emulation-with-DOSBox- http://www.columbia.edu/~em36/pcltopdf.html https://sourceforge.net/projects/vjoystick/ https://en.wikipedia.org/wiki/Cyrix_6x86 OK. Let’s talk the grandpa’s OS, the Dos. You may wonder, is DOS still survived at some corners in Silicon Valley in USA, the Most Developed digital and AI-pioneer area? The answer is “IT DID”. Here are some photos to rock you! From left to right, bottom to top, you can see Dos, 3 ISA cards, Clinic Lab PC and 80486 CPU. Those machines are used for work endurance test for workers, who are employed widely inRead More

......### PGM

Reference LikelyhoodFunction_The world is a complex place.pdf Example Likelihood: when an event......

This note is to describe the Junction Tree local consistency and global consistency (text book: P109, Example 6.1) Reference: pgm_Princeton_COS513 Foundations of Probabilistic Modelinglecture7.pdf gouws_python_2010: a master thesis on how to implement graphical model with python Text: Bayesian Reasoning and Machine Learning Junction tree property(JTP): For each pair U, V of cliques with intersection S, all cliques on the path between U and V contain S. (from gouws_python_2010.pdf, a master thesis on how to implement graphical model with python) Example 1 to reflect the property Add Separators in diagram b), you may findRead More

......The note is to generate the Junction Tree step by step, with two examples, one is simple BN, another is complex BN. Reference: PGM_CS 731 Advanced methods in artificial intelligence, with biomedical applications (Fall 2009): http://pages.cs.wisc.edu/~dpage/cs731/lecture5.ppt Text: Bayesian Reasoning and Machine Learning https://en.wikipedia.org/wiki/Kruskal%27s_algorithm Sample 1: Below is a full procedure on how to generate a Junction tree with complete potential and separators from simple Bayes model Problem: Turn it into Cliques graph: moralized, and triangulated Here is the cliques set: {ABC} {BCD} {CDE} {DEF} Turn it into aRead More

......