The man was arrested without being able to hurt the Operation Sentinel soldier according to French media, citing the Police Department.
Later on Friday, the Paris prosecutor's office said that counterterrorism investigators opened a probe into the incident, based on preliminary examination of the attacker's background and the method and target of the attack.
The French army's anti-terrorism Operation Sentinel was established following the 2015 terrorist attacks in Paris.
That attack came just four days after Sentinelle soldiers arrested an 18-year-old with a history of psychological problems at the Eiffel Tower, after he had allegedly brandished a knife and shouted "Allahu Akbar" (God is Greatest).
"This new attack legitimizes what we want to do", French Defense Minister Florence Parly told Europe 1.
He took the attacker under control following the attack. The attacker was overpowered by the soldier and arrested.
Including the attacks today in Paris and Burgundy, France has already seen 10 terrorist incidents in 2017.
In April, a police officer was killed in a shooting on the Champs-Elysées.
According to first elements of investigation, assailant quickly overpowered by military, would have held about referring to Allah, said a police source. Police later said on Twitter that the attacker had been "neutralized" and taken to hospital.
France has been the victim of a string of ISIS-inspired terror attacks in the past two years, most notably the November 2015 atrocities that claimed the lives of 130 people.