Now the terrace chant has inspired a full-length charity single which has been released to support the team as they approach the finals of the RaboDirect PRO12 league.
The song ,which is sung to the tune of the 1970s Village People track Go West, has been put together over the last two weeks by a diverse range of Ulster Rugby fans.
It features vocals from Newtownards singer Jeff Anderson, an ex-Schools Cup finalist who impressed viewers of Lord Andrew Lloyd-Webber's Jesus Christ Superstar television talent search last year.
The 22-year-old -- the frontman of rock band Wanted Alive -- told the Belfast Telegraph he wanted to record the song to support the Ulster team and also to honour the memory of Nevin Spence, whom he knew from Ulster Schools Trials.
Nevin (22) was killed in a farm accident alongside his father and brother in September of last year.
Jeff said: "I love rugby and try to get to Ravenhill matches as much as I can. Ulster is one of the best teams in Europe and we need to support them no matter what.
"Everyone can sing along and get motivated by the song. It's supporting two great charities, so we hope that everyone will get behind it."
The song is available now on iTunes, priced just 79p, with all the proceeds going to the IRFU Charitable Trust and Children in Need.
Jeff called on the services of renowned musician John Anderson, the composer, director and producer behind the award-winning Titanic Centenary Commemoration concert, to help with the song.
Last night John, who is working on a new choral project called Voices of Ireland, said: "I had worked with Jeff prior to him going into Superstar and it was obvious singing was going to be his path.
"I'm a big Ulster Rugby fan so I was delighted to work with him to help put together Stand up for the Ulstermen.
"Go West by the Village People is a particularly catchy tune and it seems to have been adopted by the Ulster Rugby fans."
Also helping with the rousing track is Mark Wilson, a six-time world champion drummer and Titanic Drums lead along with Donaghadee Male Voice and Grosvenor choirs.
COMMENT RULES: Comments that are judged to be defamatory, abusive or in bad taste are not acceptable and contributors who consistently fall below certain criteria will be permanently blacklisted. The moderator will not enter into debate with individual contributors and the moderator’s decision is final. It is Belfast Telegraph policy to close comments on court cases, tribunals and active legal investigations. We may also close comments on articles which are being targeted for abuse. Problems with commenting? email@example.com