You can only earn one Memoria per character per day.
Please note that you cannot get Memoria from the characters who visit immediately after you change Gates. You will have to wait until the next visit.