Android isn't windows, most of the ram is supposed to be full. Empty ram is wasted ram.
Your lag is because of something else. Could be some app you installed, reset permissions for everything and then use the phone, as you allow apps the permissions they want see after what the lag comes back.
You cold also boot in safe mode and see if there is any lag there, if not its something you installed that's causing it.
