A wallet is the keypair that controls an address. The public address is where funds live and can be watched by anyone; the private key is the only thing that can move them.
Because addresses are public, on-chain analysis is possible at all. Because keys are private, the person behind an address is not automatically known, which is the entire challenge of attribution.