For better accesibiity, don't remove the outline. Instead, try styling it to fit into your design. This demo shows the example.
Try navigating only with the Tab key in your keyboard.
