"Hey Siri" might be turned on. You can turn it off by going to Settings, Siri, and check the toggle on "Allow Hey Siri". I've never had Siri self actuate unless "Hey Siri" was on.