This article, for the first time, presents a technique to realize controllable multiple band rejection notches in high-order miniaturized ultra-wideband filters employing the E-shaped microstrip structure. In this technique, the filter circuit is composed of a double layer substrate where on the bottom layer the main filter circuit uses a cascaded E-shaped microstrip; the structure is developed and on the top layer the notches circuit employs a square-loop shape, where the structure is etched. These two filter circuits are capacitively coupled using overlapping microstrip lines. To demonstrate the technique and design process, several examples are designed, fabricated, and measured. One particular example is a fifth-order ultra-wideband bandpass filter with multiple rejection notches in which each notched band has a second-order stopband response. The filter size is very small, about 5.7 mm × 6.5 mm × 0.63 mm, excluding the feeding ports.