DatasetGenerationError: An error occurred while generating the dataset [closed]

Im trying to load my Publaynet dataset from s3 bucket to data bricks using huggingface datasets like this:

dataset_id = "/dbfs/mnt/ocr/dataset/publaynet" dataset = load_dataset(dataset_id, data_files={"train": "/dbfs/mnt/ocr/dataset/publaynet/train.json", "validation": "/dbfs/mnt/ocr/dataset/publaynet/val.json"}, split="train", cache_dir="./cache") 

My S3 bucket is in formal like below screenshot:

Im getting this error in databricks:

Related questions 0 I'm trying to convert Pandas dataframe to HuggingFace DatasetDic 0 Problem using Huggingface imagenet-1k dataset in Keras / Tensorflow 0 Function returning a dataset in R Related questions 0 I'm trying to convert Pandas dataframe to HuggingFace DatasetDic 0 Problem using Huggingface imagenet-1k dataset in Keras / Tensorflow 0 Function returning a dataset in R 5 CelebA Dataset inaccessible using tfds.load() Load 1 more related questions Show fewer related questions