sparknlp_jsl.transpiler.uploader#
- The script provides functionality to upload Scala code to Git, handling the transpilation
process and updating Markdown files containing both Python and Scala code.
Module Contents#
Functions#
|
Applies the upload_scala_code_in_git method to all Markdown files in the specified directory. |
|
Uploads Scala code to md_file, handling the transpilation process and updating Markdown files. |
Attributes#
- apply_method_to_all_md_files(directory_path)#
Applies the upload_scala_code_in_git method to all Markdown files in the specified directory.
- Parameters:
directory_path (str) – Path to the directory containing Markdown files.
- upload_scala_code_in_md_file(md_file_path, spark=None)#
Uploads Scala code to md_file, handling the transpilation process and updating Markdown files.
- Parameters:
md_file_path (str) – Path to the Markdown file.
- Returns:
A dictionary containing the results for the given Markdown file.
- Return type:
dict
- generated_code_failed = 0#
- generated_code_works = 0#
- python_code_failed = 0#
- results_list = []#
- scala_code_works = 0#
- scala_generated = 0#