feat(datadrift): Adding data drift module - #419
vcerqueira wants to merge 8 commits into
Conversation
|
Hi @vcerqueira. Great work on this. New methods yay 🤤 . I have fixed the doc issues for you, since I know how painful they are when your not familiar with sphinx. The change was adding mapping to external docs I took some screen shots for @vcerqueira / @hmgomes to review. Are you happy with where everything is. I think you did a great job with the documentation. I'm confident a user will be able to figure out how to wire everything up.
|
|
Hi Anton @tachyonicClock , Thanks!! The images look good. And of course, move things around as you see fit. |
|
Hi @vcerqueira , can you check the backlog? I have just put out a more comprehensive review there, but regardless this is looking good already |
|
Sure, thanks. Will take care of it soon |



Adds a data drift module next to the existing concept drift detectors.
Concept drift detectors watch a scalar error signal (
REQUIRES_FIT = False). Data drift detectors compare incoming features to a reference distribution (REQUIRES_FIT = True). Both families stay in thecapymoa.drift.detectorsnamespace.The shared base class handles the sliding test window, per-feature tests, Bonferroni correction, and detection bookkeeping. A reference is set with
fit(X_ref)or collected from the stream withauto_fit_samples.14 detectors:
Also adds
DataDriftResult(statistic, optional p-value/distance, per-feature flags), a tutorial notebook (notebooks/data_drift_detection.ipynb), and unit tests for instantiation, fit, detection, andget_params().Also extends tests/test_detector.py to cover basic aspects of data drift methods.