So anyway I could jiggle the rockers really loosely so I knew then something was wrong. They should be pretty tight. Once you loosen the 10mm retaining nut and 14mm pivot nut from the rockers you can take them off to inspect them. At that point the pushrods also come out of the engine so I put those to the side. I actually thought that the valve rocker was the whole problem so I ordered a couple new ones to replace them both. In addition to those I ordered all new rubber seals, a blade assembly main bearing, and all the appropriate gaskets.
Order up some parts and had to wait a couple days for them to come in.