The Government is investing £5 million in encouraging people to take more exercise.
Public health minister Anna Soubry said more than a quarter of people do not exercise for even 30 minutes a week, although more than half do the recommended 2.5 hours a week.
Data also shows that only a third of boys and a quarter of girls are active for at least 60 minutes a day - the recommended amount for children.
Ms Soubry said: "It's fantastic that more than half of English adults are doing the recommended amount of physical activity, but I am shocked that more than a quarter are not getting even 30 minutes of exercise a week.
"We were all inspired by the Olympics and Paralympics and as part of their legacy we want to encourage everyone - children and adults - to get active and get healthy.
"We want to do everything we can to help people lead longer, healthier lives, which is why for the first time ever, we've given local authorities increased and ring-fenced budgets to tackle public health issues in their local area."
The £5 million will be split between Change4Life Sports Clubs (£3 million), Street Play, which encourages families to play on the street with games such as hopscotch (£1.1 million), and initiatives to get people walking more often. (£1 million).
The Youth Sport Trust will use its £3 million to extend Change4Life School Sports Clubs to regions with the highest rates of childhood obesity. There are already more than 8,000 clubs around the country.
John Steele, chief executive of the Youth Sport Trust, said: "This new funding is a major boost and will help to build an even stronger network of school sport clubs across the country, offering young people the opportunity to try a range of new sports.
"Supporting schools to engage less active children in physical activity and school sport and making this fun is vital to ensure they go on to lead healthy and active lifestyles. We know that young people were inspired by what they saw last year, so now we need to turn this inspiration into participation; we don't want them put off physical activity for life."