Why not try one of those live traps. It traps the mouse in a 'box' so you can take it elsewhere and let it go. Any poison a mouse would ingest would end up in it's system which could end up in your cat. You can also try 'sonic blasters' which are electronic rodent control systems. Sends out a high pitched noise to drive mice away.