747610_de-DE

liliconcom

JMP 18 Parquet Support

Hi,

Now that JMP 18 supports Python, how can I convert a JMP table directly to the Apache Parquet file format without having to convert it to a CSV file first?

JMP18

Re: JMP 18 Parquet Support

I am not familiar with the parquet format, but this site shows to how write parquet files from python.

 

import pandas as pd
import pyarrow as pa
import pyarrow.parquet as pq

weather_schema = pa.schema([
('city', pa.string()),
('measurement_time', pa.timestamp('ms')),
('temperature', pa.float32()),
('atmospheric_pressure', pa.float32())
])

# Create a Pandas data frame with some sample weather data
df = pd.DataFrame({
    'city': ['New York', 'London', 'Tokyo'],
    'measurement_time': ['2022-05-01 12:00:00', '2022-05-01 12:00:00', '2022-05-01 12:00:00'],
    'temperature': [20.5, 15.2, 23.1],
    'atmospheric_pressure': [101.5, 99.2, 100.1]
})

# Convert the Pandas DataFrame to a PyArrow table
table = pa.Table.from_pandas(df, schema=weather_schema)

# Write the PyArrow table to a Parquet file
pq.write_table(table, 'test/weather_data.parquet')

https://saturncloud.io/blog/how-to-write-data-to-parquet-with-python/

 

 

Re: JMP 18 Parquet Support

The Parquet file support in JMP was mentioned during the JMP18 training last week.

Re: JMP 18 Parquet Support

Yes, specifically through python.  I mentioned the data import of parquet files as an example of the value of the python integration in JMP 18.

Betreff: JMP 18 Parquet-Unterstützung

Okay, aber ich frage nach dem Exportieren einer JMP-Datei direkt aus JMP 18 in ein Parquet-Dateiformat.

Betreff: JMP 18 Parquet-Unterstützung

Um eine JMP-Datentabelle nach Parquet zu exportieren, müssen Sie Python ähnlich wie im oben gezeigten Beispiel verwenden. JMP selbst unterstützt Parquet nicht.

Betreff: JMP 18 Parquet-Unterstützung

Ich verstehe. Danke.