Ultracold atomic gases in two dimensions tuned close to a p-wave Feshbach resonance were expected to exhibit topological superfluidity, but these were found to be experimentally unstable. We show that one can induce a topological Floquet superfluid if weakly interacting atoms are brought suddenly close (“quenched”) to such a resonance, in the time before the instability kicks in. The resulting superfluid possesses Majorana edge modes, yet differs from a conventional Floquet system as it is not driven externally. Instead, the periodic modulation is self-generated by the dynamics.