You can swap between the past and the present by tapping on [Memory Fragment], which can be found on both the Real World and SEKAI map screens.