Skip to content

Commit b4a0036

Browse files
committed
Add Apache Spark Parquet examples to README and guides
This commit includes references to a new example showcasing data and ML model export from Apache Spark using Parquet files. Updates were made to both the README and guides section, highlighting visualization with Kandy and integration details.
1 parent 4ea5ed4 commit b4a0036

File tree

2 files changed

+7
-0
lines changed

2 files changed

+7
-0
lines changed

docs/StardustDocs/topics/guides/Guides-And-Examples.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -105,6 +105,10 @@ Explore our extensive collection of practical examples and real-world analytics
105105
— analyze IMDb data stored in MariaDB using Kotlin DataFrame
106106
and visualize with [Kandy](https://kotlin.github.io/kandy/).
107107

108+
* [Reading Parquet files from Apache Spark](https://github.com/Kotlin/dataframe/tree/master/examples/idea-examples/spark-parquet-dataframe)
109+
— this project showcases how to export data and ML models from Apache Spark via reading from Parquet files.
110+
Also, [Kandy](https://kotlin.github.io/kandy/) used to visualize the exported data and Linear Regression model.
111+
108112
See also [Kandy User Guides](https://kotlin.github.io/kandy/user-guide.html)
109113
and [Examples Gallery](https://kotlin.github.io/kandy/examples.html)
110114
for the best data visualizations using Kotlin DataFrame and Kandy together!

examples/README.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -11,11 +11,14 @@ Also includes [Kotlin DataFrame Compiler Plugin](https://kotlin.github.io/datafr
1111
* [json](idea-examples/json) Using OpenAPI support in DataFrame's Gradle and KSP plugins to access data from [API guru](https://apis.guru/) in a type-safe manner
1212
* [imdb sql database](https://github.com/zaleslaw/KotlinDataFrame-SQL-Examples) This project prominently showcases how to convert data from an SQL table to a Kotlin DataFrame
1313
and how to transform the result of an SQL query into a DataFrame.
14+
* [spark-parquet-dataframe](idea-examples/spark-parquet-dataframe) This project showcases how to export data and ML models from Apache Spark via reading from Parquet files.
1415
* [unsupported-data-sources](idea-examples/unsupported-data-sources) Showcases of how to use DataFrame with
1516
(momentarily) unsupported data libraries such as [Spark](https://spark.apache.org/) and [Exposed](https://github.com/JetBrains/Exposed).
1617
They show how to convert to and from Kotlin DataFrame and their respective tables.
1718
* **JetBrains Exposed**: See the [exposed folder](./idea-examples/unsupported-data-sources/src/main/kotlin/org/jetbrains/kotlinx/dataframe/examples/exposed)
1819
for an example of using Kotlin DataFrame with [Exposed](https://github.com/JetBrains/Exposed).
20+
* **Hibernate**: See the [hibernate folder](./idea-examples/unsupported-data-sources/src/main/kotlin/org/jetbrains/kotlinx/dataframe/examples/hibernate)
21+
for an example of using Kotlin DataFrame with [Hibernate](https://hibernate.org/orm/).
1922
* **Apache Spark**: See the [spark folder](./idea-examples/unsupported-data-sources/src/main/kotlin/org/jetbrains/kotlinx/dataframe/examples/spark)
2023
for an example of using Kotlin DataFrame with [Spark](https://spark.apache.org/).
2124
* **Spark (with Kotlin Spark API)**: See the [kotlinSpark folder](./idea-examples/unsupported-data-sources/src/main/kotlin/org/jetbrains/kotlinx/dataframe/examples/kotlinSpark)

0 commit comments

Comments
 (0)