# processor

`core.processor`

Data processing module.

## Classes

| Name | Description |
|----|----|
| [DataProcessor](#nova_fde.core.processor.DataProcessor) | Data processing system. |

### DataProcessor

``` python
core.processor.DataProcessor(self)
```

Data processing system.

#### Methods

| Name | Description |
|----|----|
| [deduplicate_columns](#nova_fde.core.processor.DataProcessor.deduplicate_columns) | Remove duplicate columns. |
| [optimize_memory](#nova_fde.core.processor.DataProcessor.optimize_memory) | Optimize DataFrame memory usage. |
| [process_systems_data](#nova_fde.core.processor.DataProcessor.process_systems_data) | Process systems data. |

##### deduplicate_columns

``` python
core.processor.DataProcessor.deduplicate_columns(df)
```

Remove duplicate columns.

###### Parameters

| Name | Type | Description | Default |
|----|----|----|----|
| df | pd.DataFrame | Input DataFrame with potential duplicate columns | *required* |

###### Returns

| Name | Type | Description |
|----|----|----|
|  | Tuple\[pd.DataFrame, Dict\] | Deduplicated DataFrame and mapping of removed columns |

##### optimize_memory

``` python
core.processor.DataProcessor.optimize_memory(df)
```

Optimize DataFrame memory usage.

###### Parameters

| Name | Type         | Description                 | Default    |
|------|--------------|-----------------------------|------------|
| df   | pd.DataFrame | Input DataFrame to optimize | *required* |

###### Returns

| Name | Type         | Description                |
|------|--------------|----------------------------|
|      | pd.DataFrame | Memory-optimized DataFrame |

##### process_systems_data

``` python
core.processor.DataProcessor.process_systems_data(df, optimize_memory=True)
```

Process systems data.

###### Parameters

| Name | Type | Description | Default |
|----|----|----|----|
| df | pd.DataFrame | Input DataFrame to process | *required* |
| optimize_memory | bool | Whether to optimize memory usage, by default True | `True` |

###### Returns

| Name | Type         | Description         |
|------|--------------|---------------------|
|      | pd.DataFrame | Processed DataFrame |