WebP is the format that resolves the usual dilemma. It supports full alpha transparency the way PNG does, but compresses far more efficiently — commonly 25–50% below an already-compressed PNG, and dramatically below a photographic one.
Every current browser supports it. The one place to be careful is anywhere the file will be opened by older desktop software, which may not read WebP at all — keep a PNG for those.