That being said...

John: The initial results were disappointing.

Alice: Yes, the first trial wasn't successful.

John: That being said, we can learn from our mistakes.

Alice: Precisely. That being said, we should continue experimenting.