747610_en-US

liliconcom

JMP 18 Parquet Support

Hi,

Now that JMP 18 supports Python, how can I convert a JMP table directly to the Apache Parquet file format without having to convert it to a CSV file first?

JMP18

Re: JMP 18 Parquet Support

I am not familiar with the parquet format, but this site shows to how write parquet files from python.

import pandas as pd
import pyarrow as pa
import pyarrow.parquet as pq

weather_schema = pa.schema([
('city', pa.string()),
('measurement_time', pa.timestamp('ms')),
('temperature', pa.float32()),
('atmospheric_pressure', pa.float32())
])

# Create a Pandas data frame with some sample weather data
df = pd.DataFrame({
    'city': ['New York', 'London', 'Tokyo'],
    'measurement_time': ['2022-05-01 12:00:00', '2022-05-01 12:00:00', '2022-05-01 12:00:00'],
    'temperature': [20.5, 15.2, 23.1],
    'atmospheric_pressure': [101.5, 99.2, 100.1]
})

# Convert the Pandas DataFrame to a PyArrow table
table = pa.Table.from_pandas(df, schema=weather_schema)

# Write the PyArrow table to a Parquet file
pq.write_table(table, 'test/weather_data.parquet')

https://saturncloud.io/blog/how-to-write-data-to-parquet-with-python/

Re: JMP 18 Parquet Support

The Parquet file support in JMP was mentioned during the JMP18 training last week.

Re: JMP 18 Parquet Support

Yes, specifically through python. I mentioned the data import of parquet files as an example of the value of the python integration in JMP 18.

Re: JMP 18 Parquet Support

Okay, but I am asking about exporting a JMP file to a Parquet file format directly from JMP 18.

Re: JMP 18 Parquet Support

To export a JMP data table to Parquet, you would need to use python similar to the example I showed above.  JMP by itself does not support Parquet.

Re: JMP 18 Parquet Support

I see. Thank you.