Having said that...

John: I think we should proceed with caution.

Alice: I agree; there are risks involved.

John: Having said that, the potential rewards are significant.

Alice: Having said that, we need a contingency plan.