The color harmony in video was no way to know for giving pleasure. By identifying these color harmony, it gives order, clarity, similarity, contrast, etc. Therefore, to identify the color balance is very important. Color Harmony identify the color is whether the harmony by color harmony theory of Munsell, Ostwald, Firren, Moon & Spenser, Itten, Chevreul, and Judd etc. One of these methods, we identify color harmonies of 2 colors, 3 colors, 4 colors, 5 colors and 6 colors using Itten's color balance. Identification is using by Canny edge extraction, labeling and clustering, and color extraction and harmony etc. By identifying this color harmonies, we have laid the foundation of emotional database construction and emotional recognition.