General Robinson ordered Baxter's brigade to position north against Rodes' approaching division. Also, Howard's XI Corps had begun to arrive from the south and started deploying to the east. Rodes, sensing his advantage evaporate, decided to immediately attack. Unfortunately, the attack was poorly coordinated and ran into problems. Iverson's and O'Neal's brigades were ordered to advance along Oak Ridge and attack Baxter's newly acquired position. Instead, Iverson delayed the attack so that the artillery atop Oak Hill could inflict more damage upon Baxter. The left O'Neal in front alone and approaching Baxter who was positioned behind a stone wall along Mummasburg Road. Baxter made short work of O'Neal and inflicted over 40% casualties (both O'Neal and Iverson themselves amazingly did not accompany their brigades). Iverson now followed along the western slope of Oak Ridge (on what would've been to O'Neal's right). Now that O'Neal had retreated, Iverson's left flank was completely exposed. With O'Neal out of the way, Baxter was able to shift its complete attention to Iverson. Iverson's brigade marched blindly into Baxter's awaiting brigade with devastating results. An amazing 70% of the brigade were either captured or became casualties. These two Rodes' brigades had effectively been destroyed.

Rodes then ordered Daniel and Ramseur into the battle. Daniel planned to march southward along the western slope of the ridge, out of range of Robinson's brigades and swing around to attack Cutler's left flank. But, as it approached Chambersburg Pike, it encountered Stone's brigade which had been positioned along the railroad cut. Despite heavy casualties on both sides, Stone managed to hold the cut. Ramseur on the other hand, marched along Iverson's previous route following Oak Ridge. By this time, Robinson had reinforced Baxter's position at Mummasburg Road with Paul's brigade. This time, Ramseur attacked Baxter and Paul until they ran low on ammunition and slowly forced to retreat with heavy casualties.

The remaining stretched in anticipation of Early's soon arrival. Sensing a good vantage point, part of Doles' brigade attempted to occupy a small knoll to the west of Harrisburg Road. Barlow also eyed this knoll and sent Van Gilsa forward to extend the Union right flank. In order to compensate for Barlow's advance position, Schurz ordered Schimmelfennig forward to align with Van Gilsa and Paul. Barlow and Schurz had barely positioned their divisions when Early's division approached from the northeast along Harrisburg Road. BG Gordon's brigade led the attack and charged Van Gilsa while BG Hays and Col Avery attacked Ames' right flank. Barlow's forward position was exposed and could not be held (in fact, his men began running as soon as Gordon attacked). Doles, seizing on the opportunity, attacked Schurz and soon both Union divisions were sent retreating towards town.