graalpython icon indicating copy to clipboard operation
graalpython copied to clipboard

Adding C-Python compatible API for embedding GraalPy

Open lokmeinmatz opened this issue 1 year ago • 1 comments

This is a WIP as outcome from a project seminar at HPI, supervised by @timfel

Main idea is:

  • generate a new dylib from the com.oracle.graal.python.c_embed Cmake project
  • link against pythonnative lib from "cext" as well as "pythonvm" lib from graalpy itself
  • c_embed handles
    • creating graal isolate
    • calling to graalpy so it can set Builtins, create PythonLanguage context etc.
    • taking the GIL because this is how C-python behaves
  • Cleanup (not implemented yet)

The rest of the API calls are made to the methods in cext (works because everything is in flat namespace when linked together)

The example embedding was developed using Rust & pyo3. https://github.com/lokmeinmatz/pyo3/tree/graalpy_impl

in Folder examples/basic_rust_to_py is an example that is configured to work with GraalPy (may need some extra config to link on other OS than OSX)

lokmeinmatz avatar Feb 10 '24 11:02 lokmeinmatz

Thank you for your pull request and welcome to our community! To contribute, please sign the Oracle Contributor Agreement (OCA). The following contributors of this PR have not signed the OCA:

To sign the OCA, please create an Oracle account and sign the OCA in Oracle's Contributor Agreement Application.

When signing the OCA, please provide your GitHub username. After signing the OCA and getting an OCA approval from Oracle, this PR will be automatically updated.

If you are an Oracle employee, please make sure that you are a member of the main Oracle GitHub organization, and your membership in this organization is public.