House of Commons Deputy Speaker Nigel Evans will give up chairing MPs' debates temporarily as he fights allegations of rape and sexual assault relating to two men.
But the 55-year-old Conservative MP, who strongly denied the claims, is refusing to stand down from the post formally while he tries to clear his name.
He was arrested at his home in Pendleton, Lancashire, on Saturday on suspicion of raping one man and sexually assaulting another — both in their twenties — between July 2009 and March 2013.
He was questioned by police for several hours before being released on bail until 19 June.
Yesterday Mr Evans told reporters the allegations had been “made by two people who are well known to each other and until yesterday, I regarded as friends”.
He said: “The complaints are completely false and I cannot understand why they have been made, especially as I have continued to socialise with one as recently as last week.”
The MP added: “I appreciate the way the police have handled this in such a sensitive manner and I would like to thank my colleagues, friends and members of the public who have expressed their support and, like me, a sense of incredulity at these events.”
Mr Evans, who came out as gay in 2010, is a popular figure at Westminster among MPs in all parties.
But a Cabinet minister voiced the doubts among some MPs that he could carry on as a deputy to the Speaker, John Bercow.
“I stick rigidly to the view that we should treat people as innocent until they are proven guilty, but it is quite difficult to carry out a sensitive and high-profile role while being under this kind of scrutiny.”
Mr Hammond said: “I know Nigel well, I have known him for years. I'm obviously as shocked as everybody else is.”
Mr Evans would normally have deputised for Mr Bercow during parts of a week-long Commons debate on the Queen's Speech, which will mark the start of a new parliamentary year on Wednesday. He has asked to be relieved of that role, which will now be shared by the two other deputies — Lindsay Hoyle and Dawn Primarolo.
Mr Evans could remain out of the spotlight until the Commons returns from its Whitsun recess in early June.
Commons officials said Mr Bercow could not dismiss Mr Evans or ask him to stand down until the police had concluded their inquiries, because he was elected by MPs rather than appointed. Commons sources said the issue would be kept “under review” and Mr Evans could face private pressure to stand down.
His solicitor insisted Mr Evans would carry on as a Deputy Speaker and as MP for Ribble Valley, which he has represented for 21 years.
His local party said: “The officers and members of the Ribble Valley Conservative Association have got to know and respect him and are shocked about his arrest.
“We are believers in the rule of law and are aware that these are merely allegations. In our democracy everyone accused is innocent until proven guilty.”
Tory MPs rallied strongly behind him yesterday. Andrew Bridgen, who was accused of a sex assault two years ago before police dropped their inquiries six days later, said: “Fortunately in this country we have a rule that says you are innocent until proven guilty and I think that should be maintained.
“I personally think that Nigel should be able to continue as Deputy Speaker while the police, quite rightly, carry on with their investigations.”
The Conservative high command will be anxious to avoid a by-election in Ribble Valley. Although Mr Evans had a majority of 14,769 at the last election, last week's strong second by Ukip in the South Shields by-election suggests that it could win such a seat.
In 1991, when the sitting Tory MP resigned, the Liberal Democrats won Ribble Valley in a by-election, but Mr Evans won it back at the following general election.