Tonsillitis disease is the cause of heart attack and pneumonia. It is also a sign of suspected symptom of heart disease. To improve data transfer rates, this paper proposes VLSI architecture by using color model for early-state tonsillitis detection. In this method, input image is divided into 9 blocks. Each block has 3times3 window which send color data and pixel address to computation box. The system compares the feature values between the normal tonsillitis disease image and the image under detection. These feature values would be input into system for decision support system. Prototype architecture is designed to implement in tonsillitis detection. It has been modeled in VHDL.