You could write your own class which extends JPanel and implements KeyListener. Also it should override JPanel's add-method, and it that method you can assign every component you add an KeyListerner
ex.
import javax.swing.*;
import java.awt.*;
import java.awt.event.*;
public class KeyPanel...