DatasetJob
DashAI.back.job.DatasetJob
Job for processing and uploading datasets using streaming data processing.
Parameters
kwargs : Dict[str, Any] A dictionary containing the parameters for the job, including:
- name: Name of the dataset
- datatype_name: Name of the datatype
- params: Parameters for the datatype
- file_path: Path to the temporarily saved file
- temp_dir: Directory containing the temporary file
- filename: Name of the uploaded file
- db: Database session
Methods
get_job_name(self) -> str
DatasetJobGet a descriptive name for the job.
run(self) -> None
DatasetJobRun the job.
set_status_as_delivered(self, session_factory: 'sessionmaker' = <function DatasetJob.<lambda> at 0x7f2d58f96d40>) -> None
DatasetJobSet the status of the dataset as delivered.
set_status_as_error(self, session_factory: 'sessionmaker' = <function DatasetJob.<lambda> at 0x7f2d58f97ac0>) -> None
DatasetJobSet the job status as error.