MSR-Codec

MSR-Codec: A Low-Bitrate Multi-Stream Residual Codec for High-Fidelity Speech Generation with Information Disentanglement
Jingyu Li^1, Guangyan Zhang^1, Zhen Ye^2, Yiwen Guo^3
1^LIGHTSPEED, Hong Kong SAR
2^The Hong Kong University of Science and Technology, Hong Kong SAR
3^Independent Researcher, Corresponding Author

Zero-shot TTS

Prompt Text	Prompt Speech	Generated Text	Generated Speech
On the second day, the boy climbed to the top of a cliff near the camp.		The area was swirling in dust so intense that it hid the moon from view.
She wasn't home, a neighbour said that he didn't think she came in last night.		Technically, breaking a mirror is not five years, but seven years of bad luck.
Several people are walking out in the spotlight.		A man is taking a look at the food products.
The music, while technically a waltz, sounded more like a drunken tuba player falling into the orchestra's percussion section.		One of the world's biggest problems is the growth of the human population.
She was singularly quick, singularly receptive.		Can't you see the scene? he asked with a queer smile of excitement.
Some development processes usually conducted sequentially were conducted in parallel.		In testimony to investigators, the page described the relationship as consensual and not intimidating.

Voice Conversion

Timbre Prompt	Source Audio	Cosyvoice2	Seed-VC	524+S	524+P	524+S+P
	It isn't a very pretty cabin and the furniture is cheap and common, but I'm sure it is good enough for this wicked man and his family.
	You see how doubly, how intimately, opposed the ideas are; yet how difficult to explain without apparent contradiction.
	As she said this she looked down at her hands, and was surprised to see that she had put on one of the Rabbit's little white kid gloves while she was talking.
	He had been left, by the death of their parents in India, guardian to a small nephew and a small niece, children of a younger, a military brother, whom he had lost two years before.
	The second datum is that we certainly have more capacity for knowing the past than for knowing the future.
	Captain Battleax, of the john Bright, will have received a letter to the same effect from the First Lord of the Admiralty, and you will find him ready to co-operate with your Excellency in every respect.--I have the honour to be, sir, your Excellency's most obedient servant,
	He recognized their speech collectively before he distinguished their faces.
	It is possible that I may be in a position then to indicate some course of action.
	She wouldn't know how to go about it.
	The station at Berlin comprised five boilers, and six vertical steam engines driving by belts twelve Edison dynamos, each of about fifty five horse power capacity.
	She called his name on the threshold, but in her swift flight across the room she felt a change in him and caught herself up so deftly that he could not tell just when she did it. She merely brushed his cheek with her lips and put a hand lightly and joyously on either shoulder.
	When the quasi peaceable stage of industry is reached, with its fundamental institution of chattel slavery, the general principle, more or less rigorously applied, is that the base, industrious class should consume only what may be necessary to their subsistence.