Paula Abdul may soon reunite with her “American Idol” nemesis Simon Cowell: The entertainer is in negotiations to join the judges’ panel on Cowell’s upcoming talent competition, “X Factor.”

“I’ve always wanted Paula. Always been very vocal about that,” Cowell tells Deadline. “I missed her the second she left the show. Always loved working with her even though she can be a pain.”

Cowell, who will serve as judge alongside music producer Antonio “L.A.” Reid, adds that he doesn’t quite understand his connection to Abdul. “I don’t know what it is about her, but I’ve always clicked with her. You just have to get that chemistry, and she’s right,” he says. “I’ve never found anyone better than her.”

Besides Abdul, British singer Cheryl Cole — who appears as a judge on the British edition of “X Factor”— is also in talks to join the U.S. edition.

“When I hired her initially, I’d only met her literally once when I offered her the job on [British] ‘X Factor.’ I thought she was bright, cute, knew what she was talking about, ambitious,” he says. “She’s just got a great ability to communicate. She’s a great judge. She’s smart. It’s just a hunch. If people take to her like the British public did, I think she’s going to do really well in America.”

Of course, Cole’s rep tells CNN, there hasn’t been an official announcement that the singer is joining the judges’ table for the reality show, which premieres on Fox in September.