PySuricata EDA Report

Summary

Rows

891

Columns

Processed bytes (≈)

121.4 KB

Missing

866 (8.1%)

Duplicates (≈)

0 (0.0%)

Column types

Numeric3
Categorical9
Datetime0
Boolean0

Top missing columns

Cabin 687 (77.1%)
Age 177 (19.9%)
Embarked 2 (0.2%)

Quick insights

Unique cols: 12
Constant cols: 0
High-card categoricals: 2
Date range: — → —
Text cols: 9 (avg len 5.2)

Description

Click to add description...

Sample

Show sample

	PassengerId	Survived	Pclass	Name	Sex	Age	SibSp	Parch	Ticket	Fare	Cabin	Embarked
495	496	0	3	Yousseff, Mr. Gerious	male	nan	0	0	2627	14.4583	nan	C
648	649	0	3	Willey, Mr. Edward	male	nan	0	0	S.O./P.P. 751	7.55	nan	S
278	279	0	3	Rice, Master. Eric	male	7.0	4	1	382652	29.125	nan	Q
31	32	1	1	Spencer, Mrs. William Augustus (Marie Eugenie)	female	nan	1	0	PC 17569	146.5208	B78	C
255	256	1	3	Touma, Mrs. Darwis (Hanne Youssef Razi)	female	29.0	0	2	2650	15.2458	nan	C
298	299	1	1	Saalfeld, Mr. Adolphe	male	nan	0	0	19988	30.5	C106	S
609	610	1	1	Shutes, Miss. Elizabeth W	female	40.0	0	0	PC 17582	153.4625	C125	S
318	319	1	1	Wick, Miss. Mary Natalie	female	31.0	0	2	36928	164.8667	C7	S
484	485	1	1	Bishop, Mr. Dickinson H	male	25.0	1	0	11967	91.0792	B49	C
367	368	1	3	Moussa, Mrs. (Mantoura Boulos)	female	nan	0	0	2626	7.2292	nan	C

Showing 10 randomly sampled rows from the first chunk.

Variables

Analyzing 12 variables (3 numeric, 9 categorical, 0 datetime, 0 boolean).

Showing 1-10 of 12

Count	891
Unique	891
Missing	0 (0.0%)
Outliers	0 (0.0%)
Zeros	0 (0.0%)
Infinites	0 (0.0%)
Negatives	0 (0.0%)

Min	1
Q1 (P25)	223.5
Median	446
Mean	446
Q3 (P75)	668.5
Max	891
Processed bytes (≈)	7.0 KB

Scale:

Bins:

Mean	446
Std Dev	257.4
Variance	6.623e+04
Std Error	8.622
Coeff. of Var	0.577
Geometric mean	329.4
IQR	445
MAD	223
Skew	0
Kurtosis	-1.204
Jarque–Bera χ²	53.82
95% CI (mean)	[429.1 – 462.9]
Granularity	1.01 (decimals: 2)
Heaping %	19.98

Min	1
P1 (≈)	9.9
P5 (≈)	45.5
P10 (≈)	90
Q1 (P25)	223.5
Median (P50)	446
Q3 (P75)	668.5
P90 (≈)	802
P95 (≈)	846.5
P99 (≈)	882.1
Range	890
Std Dev	257.4

Rank	Value	Count	Frequency
1ˢᵗ	868	1	0.1%
2ⁿᵈ	869	1	0.1%
3ʳᵈ	870	1	0.1%
4ᵗʰ	871	1	0.1%
5ᵗʰ	872	1	0.1%
6ᵗʰ	873	1	0.1%
7ᵗʰ	874	1	0.1%
8ᵗʰ	875	1	0.1%
9ᵗʰ	876	1	0.1%
10ᵗʰ	877	1	0.1%

Min values

Index	Value
0	1
1	2
2	3
3	4
4	5

Max values

Index	Value
890	891
889	890
888	889
887	888
886	887

📉 Low Outliers 0 outliers (0.0%)

Extreme: 0 High: 0 Moderate: 0

📈 High Outliers 0 outliers (0.0%)

Extreme: 0 High: 0 Moderate: 0

📊 No significant correlations found Correlations below 0.5 threshold are not shown

Data Completeness

Present: 891 (100.0%) Missing: 0 (0.0%)

Missing Values per Chunk

1 chunks analyzed Peak: 0.0%

Low (0-5%) Medium (5-20%) High (20%+)

Count	891
Unique (≈)	2
Missing	0 (0.0%)
Mode	`0`
Mode %	61.6%
Empty strings	549

Entropy	0.9607
Rare levels	0 (0.0%)
Top 5 coverage	100.0%
Label length (avg)	NaN
Length p90	—
Processed bytes (≈)	0.0 B

Top‑N:

Rank	Value	Count	Frequency	Distribution
1ˢᵗ	0	549	61.6%
2ⁿᵈ	1	342	38.4%

Original	lower()	strip()
—

Missing Values

Data Completeness

Present: 891 (100.0%) Missing: 0 (0.0%)

Count	891
Unique (≈)	3
Missing	0 (0.0%)
Mode	`3`
Mode %	55.1%
Empty strings	0

Entropy	1.439
Rare levels	0 (0.0%)
Top 5 coverage	100.0%
Label length (avg)	NaN
Length p90	—
Processed bytes (≈)	0.0 B

Top‑N:

Rank	Value	Count	Frequency
1ˢᵗ	3	491	55.1%
2ⁿᵈ	1	216	24.2%
3ʳᵈ	2	184	20.7%

Original	lower()	strip()
—

Missing Values

Data Completeness

Present: 891 (100.0%) Missing: 0 (0.0%)

Count	891
Unique (≈)	892
Missing	0 (0.0%)
Mode	`Allison, Miss. Helen Loraine`
Mode %	0.1%
Empty strings	0

Entropy	0.264
Rare levels	24 (2.7%)
Top 5 coverage	0.6%
Label length (avg)	NaN
Length p90	—
Processed bytes (≈)	0.0 B

Top‑N:

Rank	Value	Count	Frequency
1ˢᵗ	Allison, Miss. Helen Loraine	1	0.1%
2ⁿᵈ	Barber, Miss. Ellen "Nellie"	1	0.1%
3ʳᵈ	Baxter, Mrs. James (Helene DeLaudeniere Chaput)	1	0.1%
4ᵗʰ	Bishop, Mrs. Dickinson H (Helen Walton)	1	0.1%
5ᵗʰ	Connolly, Miss. Kate	1	0.1%
6ᵗʰ	Dooley, Mr. Patrick	1	0.1%
7ᵗʰ	Dorking, Mr. Edward Arthur	1	0.1%
8ᵗʰ	Haas, Miss. Aloisia	1	0.1%
9ᵗʰ	Hanna, Mr. Mansour	1	0.1%
10ᵗʰ	Hosono, Mr. Masabumi	1	0.1%

Original	lower()	strip()
`Allison, Miss. Helen Loraine`	`allison, miss. helen loraine`	`Allison, Miss. Helen Loraine`
`Barber, Miss. Ellen "Nellie"`	`barber, miss. ellen "nellie"`	`Barber, Miss. Ellen "Nellie"`
`Baxter, Mrs. James (Helene DeLaudeniere Chaput)`	`baxter, mrs. james (helene delaudeniere chaput)`	`Baxter, Mrs. James (Helene DeLaudeniere Chaput)`
`Bishop, Mrs. Dickinson H (Helen Walton)`	`bishop, mrs. dickinson h (helen walton)`	`Bishop, Mrs. Dickinson H (Helen Walton)`
`Connolly, Miss. Kate`	`connolly, miss. kate`	`Connolly, Miss. Kate`
`Dooley, Mr. Patrick`	`dooley, mr. patrick`	`Dooley, Mr. Patrick`

Missing Values

Data Completeness

Present: 891 (100.0%) Missing: 0 (0.0%)

Count	891
Unique (≈)	2
Missing	0 (0.0%)
Mode	`male`
Mode %	64.8%
Empty strings	0

Entropy	0.9362
Rare levels	0 (0.0%)
Top 5 coverage	100.0%
Label length (avg)	NaN
Length p90	—
Processed bytes (≈)	0.0 B

Top‑N:

Rank	Value	Count	Frequency	Distribution
1ˢᵗ	male	577	64.8%
2ⁿᵈ	female	314	35.2%

Original	lower()	strip()
—

Missing Values

Data Completeness

Present: 891 (100.0%) Missing: 0 (0.0%)

Count	714
Unique	88
Missing	177 (19.9%)
Outliers	11 (1.5%)
Zeros	0 (0.0%)
Infinites	0 (0.0%)
Negatives	0 (0.0%)

Min	0.42
Q1 (P25)	20.12
Median	28
Mean	29.7
Q3 (P75)	38
Max	80
Processed bytes (≈)	7.0 KB

Scale:

Bins:

Mean	29.7
Std Dev	14.53
Variance	211
Std Error	0.5436
Coeff. of Var	0.4891
Geometric mean	24.43
IQR	17.88
MAD	9
Skew	0.3875
Kurtosis	0.1598
Jarque–Bera χ²	18.63
95% CI (mean)	[28.63 – 30.76]
Granularity	0.968 (decimals: 3)
Heaping %	22.27

Min	0.42
P1 (≈)	1
P5 (≈)	4
P10 (≈)	14
Q1 (P25)	20.12
Median (P50)	28
Q3 (P75)	38
P90 (≈)	50
P95 (≈)	56
P99 (≈)	65.87
Range	79.58
Std Dev	14.53

Rank	Value	Count	Frequency
1ˢᵗ	24	23	3.2%
2ⁿᵈ	22	20	2.8%
3ʳᵈ	18	19	2.7%
4ᵗʰ	19	18	2.5%
5ᵗʰ	28	18	2.5%
6ᵗʰ	30	18	2.5%
7ᵗʰ	21	17	2.4%
8ᵗʰ	36	17	2.4%
9ᵗʰ	25	16	2.2%
10ᵗʰ	29	13	1.8%

Min values

Index	Value
803	0.42
755	0.67
469	0.75
644	0.75
78	0.83

Max values

Index	Value
630	80
851	74
493	71
96	71
116	70.5

📉 Low Outliers 0 outliers (0.0%)

Extreme: 0 High: 0 Moderate: 0

📈 High Outliers 7 outliers (1.0%) (showing top 7 of 11 total)

IQR: Extreme: 0 High: 2 Moderate: 5

MAD: Extreme: 1 High: 0 Moderate: 0

💡 This shows the most extreme outliers from a representative sample. The general statistics show all 11 outliers (1.5%) in the full dataset.

Rank	Index	Value	Method	Severity
1ˢᵗ	630	80	IQR Method	High (2.3× IQR)
1ˢᵗ	630	80	MAD Method	Extreme (5.8× MAD)
2ⁿᵈ	851	74	IQR Method	High (2.0× IQR)
3ʳᵈ	493	71	IQR Method	Moderate (1.8× IQR)
4ᵗʰ	116	70.5	IQR Method	Moderate (1.8× IQR)
5ᵗʰ	—	70	IQR Method	Moderate (1.8× IQR)
6ᵗʰ	—	66	IQR Method	Moderate (1.6× IQR)
7ᵗʰ	—	65	IQR Method	Moderate (1.5× IQR)

ℹ️ Index shown only for top/bottom extreme values tracked during profiling. Sample-based outliers may not have row indices.

📊 No significant correlations found Correlations below 0.5 threshold are not shown

Data Completeness

Present: 714 (80.1%) Missing: 177 (19.9%)

Missing Values per Chunk

1 chunks analyzed Peak: 19.9%

Low (0-5%) Medium (5-20%) High (20%+)

Count	891
Unique (≈)	7
Missing	0 (0.0%)
Mode	`0`
Mode %	68.2%
Empty strings	608

Entropy	1.339
Rare levels	2 (1.3%)
Top 5 coverage	98.7%
Label length (avg)	NaN
Length p90	—
Processed bytes (≈)	0.0 B

Top‑N:

Rank	Value	Count	Frequency
1ˢᵗ	0	608	68.2%
2ⁿᵈ	1	209	23.5%
3ʳᵈ	2	28	3.1%
4ᵗʰ	4	18	2.0%
5ᵗʰ	3	16	1.8%
6ᵗʰ	8	7	0.8%
7ᵗʰ	5	5	0.6%

Original	lower()	strip()
—

Missing Values

Data Completeness

Present: 891 (100.0%) Missing: 0 (0.0%)

Count	891
Unique (≈)	7
Missing	0 (0.0%)
Mode	`0`
Mode %	76.1%
Empty strings	678

Entropy	1.128
Rare levels	4 (1.7%)
Top 5 coverage	99.4%
Label length (avg)	NaN
Length p90	—
Processed bytes (≈)	0.0 B

Top‑N:

Rank	Value	Count	Frequency
1ˢᵗ	0	678	76.1%
2ⁿᵈ	1	118	13.2%
3ʳᵈ	2	80	9.0%
4ᵗʰ	3	5	0.6%
5ᵗʰ	5	5	0.6%
6ᵗʰ	4	4	0.4%
7ᵗʰ	6	1	0.1%

Original	lower()	strip()
—

Missing Values

Data Completeness

Present: 891 (100.0%) Missing: 0 (0.0%)

Count	891
Unique (≈)	716
Missing	0 (0.0%)
Mode	`113043`
Mode %	0.1%
Empty strings	0

Entropy	0.264
Rare levels	24 (2.7%)
Top 5 coverage	0.6%
Label length (avg)	NaN
Length p90	—
Processed bytes (≈)	0.0 B

Top‑N:

Rank	Value	Count	Frequency
1ˢᵗ	113043	1	0.1%
2ⁿᵈ	113510	1	0.1%
3ʳᵈ	19988	1	0.1%
4ᵗʰ	226593	1	0.1%
5ᵗʰ	234818	1	0.1%
6ᵗʰ	250651	1	0.1%
7ᵗʰ	2647	1	0.1%
8ᵗʰ	2693	1	0.1%
9ᵗʰ	2695	1	0.1%
10ᵗʰ	28551	1	0.1%

Original	lower()	strip()
—

Missing Values

Data Completeness

Present: 891 (100.0%) Missing: 0 (0.0%)

Count	891
Unique	821
Missing	0 (0.0%)
Outliers	116 (13.0%)
Zeros	15 (1.7%)
Infinites	0 (0.0%)
Negatives	0 (0.0%)

Min	0
Q1 (P25)	7.91
Median	14.45
Mean	32.2
Q3 (P75)	31
Max	512.3
Processed bytes (≈)	7.0 KB

Scale:

Bins:

Mean	32.2
Std Dev	49.69
Variance	2,469
Std Error	1.665
Coeff. of Var	1.543
Geometric mean	18.98
IQR	23.09
MAD	6.904
Skew	4.771
Kurtosis	33.12
Jarque–Bera χ²	4.411e+04
95% CI (mean)	[28.94 – 35.47]
Granularity	2.4973509999999997 (decimals: 10)
Heaping %	53.98

Min	0
P1 (≈)	0
P5 (≈)	7.225
P10 (≈)	7.55
Q1 (P25)	7.91
Median (P50)	14.45
Q3 (P75)	31
P90 (≈)	77.96
P95 (≈)	112.1
P99 (≈)	249
Range	512.3
Std Dev	49.69

Rank	Value	Count	Frequency
1ˢᵗ	8.05	29	3.3%
2ⁿᵈ	13	28	3.1%
3ʳᵈ	7.896	24	2.7%
4ᵗʰ	7.75	20	2.2%
5ᵗʰ	26	17	1.9%
6ᵗʰ	10.5	10	1.1%
7ᵗʰ	0	7	0.8%
8ᵗʰ	7.775	5	0.6%
9ᵗʰ	30	4	0.4%
10ᵗʰ	7.925	4	0.4%

Min values

Index	Value
179	0
263	0
271	0
302	0
277	0

Max values

Index	Value
258	512.3
679	512.3
737	512.3
88	263
341	263

📉 Low Outliers 0 outliers (0.0%)

Extreme: 0 High: 0 Moderate: 0

📈 High Outliers 10 outliers (1.1%) (showing top 10 of 116 total)

IQR: Extreme: 10 High: 0 Moderate: 0

MAD: Extreme: 10 High: 0 Moderate: 0

💡 This shows the most extreme outliers from a representative sample. The general statistics show all 116 outliers (13.0%) in the full dataset.

Rank	Index	Value	Method	Severity
1ˢᵗ	258	512.3	IQR Method	Extreme (20.8× IQR)
1ˢᵗ	258	512.3	MAD Method	Extreme (72.1× MAD)
2ⁿᵈ	88	263	IQR Method	Extreme (10.0× IQR)
2ⁿᵈ	88	263	MAD Method	Extreme (36.0× MAD)
3ʳᵈ	—	262.4	IQR Method	Extreme (10.0× IQR)
3ʳᵈ	—	262.4	MAD Method	Extreme (35.9× MAD)
4ᵗʰ	—	247.5	IQR Method	Extreme (9.4× IQR)
4ᵗʰ	—	247.5	MAD Method	Extreme (33.8× MAD)
5ᵗʰ	—	227.5	IQR Method	Extreme (8.5× IQR)
5ᵗʰ	—	227.5	MAD Method	Extreme (30.9× MAD)
6ᵗʰ	—	221.8	IQR Method	Extreme (8.3× IQR)
6ᵗʰ	—	221.8	MAD Method	Extreme (30.0× MAD)
7ᵗʰ	—	211.5	IQR Method	Extreme (7.8× IQR)
7ᵗʰ	—	211.5	MAD Method	Extreme (28.5× MAD)
8ᵗʰ	—	211.3	IQR Method	Extreme (7.8× IQR)
8ᵗʰ	—	211.3	MAD Method	Extreme (28.5× MAD)
9ᵗʰ	—	164.9	IQR Method	Extreme (5.8× IQR)
9ᵗʰ	—	164.9	MAD Method	Extreme (21.8× MAD)
10ᵗʰ	—	153.5	IQR Method	Extreme (5.3× IQR)
10ᵗʰ	—	153.5	MAD Method	Extreme (20.1× MAD)

ℹ️ Index shown only for top/bottom extreme values tracked during profiling. Sample-based outliers may not have row indices.

📊 No significant correlations found Correlations below 0.5 threshold are not shown

Data Completeness

Present: 891 (100.0%) Missing: 0 (0.0%)

Missing Values per Chunk

1 chunks analyzed Peak: 0.0%

Low (0-5%) Medium (5-20%) High (20%+)

Count	204
Unique (≈)	148
Missing	687 (77.1%)
Mode	`—`
Mode %	0.0%
Empty strings	0

Entropy	NaN
Rare levels	0 (0.0%)
Top 5 coverage	0.0%
Label length (avg)	NaN
Length p90	—
Processed bytes (≈)	0.0 B

Top‑N:

Count	889
Unique (≈)	3
Missing	2 (0.2%)
Mode	`S`
Mode %	72.4%
Empty strings	0

Entropy	1.097
Rare levels	0 (0.0%)
Top 5 coverage	100.0%
Label length (avg)	NaN
Length p90	—
Processed bytes (≈)	0.0 B

Top‑N:

Rank	Value	Count	Frequency
1ˢᵗ	S	644	72.4%
2ⁿᵈ	C	168	18.9%
3ʳᵈ	Q	77	8.7%

Original	lower()	strip()
`S`	`s`	`S`
`C`	`c`	`C`
`Q`	`q`	`Q`

Missing Values

Data Completeness

Present: 889 (99.8%) Missing: 2 (0.2%)

Correlations

📊

No significant correlations found (threshold: 0.50)

Missing Values

3 columns with missing values

Cabin

Age

Embarked

Missing per chunk:

≤5%

5-20%

>20%

Cabin

Age

Embarked