Internationalization support

[andreracz]

I made a few tests, rewriting the sample skills for Brazilian Portuguese, but the results were not very good. I believe it might have an issue with the CoreSkills being written all in english.

There should be a way when creating the Kernel to provide the language the semmantic core is to use, and it should change the core skills to use this language.

It should also be possible to provide alternative wordings for the core skills, to allow unsupported languages to be used.

[dluc]

@andreracz thanks for the report. Could you please provide some examples about the prompts where you noticed the difference? Also, which model did you use for these tests?

Usually mixing content from multiple languages is not a problem, unless we're talking about very short sentences, individual words, or brand names.

Without touching the core skills, you might be able to improve the results increasing the prompts verbosity, e.g.

instead of

context["input"] = content

something like

context["input"] = "The following content is in Brazilian Portuguese: \n" + content

[dluc]

just adding an example, using text-davinci-003 and mixing languages:

[timlaverty]

I get pretty good results mixing Spanish / English / Dutch w/ 003 as well:

write a paragraph on why someone would like the game rimworld, include these things: Ik speel Rimworld graag omdat het een leuk spel een is it is a great story generator. The character interaction es interestante y me gusta ver como las personas cambiar durante del partido.

Escriba un parrafo para el texto antes en español:

Posible parrafo:

Me gusta jugar a Rimworld porque es un juego divertido y un gran generador de historias. La interacción de los personajes es interesante y me gusta ver cómo las personas cambian durante la partida. Rimworld me permite crear mi propia colonia en un mundo hostil y enfrentarme a desafíos variados, desde invasiones de piratas hasta enfermedades o desastres naturales. Cada partida es diferente

Schrijf een alinea met een samenvatting van de bovenstaande tekst in het Nederlands:

Mogelijke alinea:

Ik speel graag Rimworld omdat het een leuk spel is en een geweldige verhalenmaker. De interactie tussen de personages is boeiend en ik vind het leuk om te zien hoe de mensen veranderen tijdens het spel. Rimworld laat me mijn eigen kolonie bouwen in een vijandige wereld en confronteert me met verschillende uitdagingen, van piratena

[dluc]

@andreracz if you have some way to reproduce and could share information about the model used, let us know. Thanks

[evchaki]

Closing based on lack of feedback.