You can cancel payment, but you have to make sure that there is any pending payment. Because you are not authorized to cancel any successful payment. So, you have to scroll your Activity feed to check pending payment status. From pending payment, tap on the cancel option to get money back from Cash app.