Chatops doesn't work in 1-1 conversations
With Marvin (cog chatops) it was possible to have a 3 way conversation and invoke chatops commands. The current implementation doesn't allow this as its based of slash commands and thus missing loads of context.
The command will be invoked, and executed, but the user only gets back that the job failed.