New Zealander Anscombe was appointed head coach in 2012 on a two-year deal to replace Brian McLaughlin. He led Ulster to the final of the RaboDirect PRO12 in his first season in charge, losing 24-18 to provincial rivals Leinster.
The news comes just weeks after Director of Rugby David Humphreys announced he was leaving to take up a role with Gloucester.
Ulster Rugby chief executive, Shane Logan, said:
"I would like to pay tribute to the contribution that Mark Anscombe made over the past two seasons and to thank him for his hard work and dedication.
"Everyone at Ulster Rugby wishes him well for the future.
"Les Kiss will have an expanded remit for the Province’s director of rugby and will lead the coaching staff, assisted by Jonny Bell and Neil Doak and will manage first team selection.
"His appointment allows us time to recruit for long-term success."
Les Kiss will start work at Ulster Rugby on July 19.
COMMENT RULES: Comments that are judged to be defamatory, abusive or in bad taste are not acceptable and contributors who consistently fall below certain criteria will be permanently blacklisted. The moderator will not enter into debate with individual contributors and the moderator’s decision is final. It is Belfast Telegraph policy to close comments on court cases, tribunals and active legal investigations. We may also close comments on articles which are being targeted for abuse. Problems with commenting? firstname.lastname@example.org