Merge pull request #331 from mlrun/marketplace-doc-gen-0164e2a

Marketplace update from marketplace-doc-gen-0164e2a

README.md

@@ -1,3 +1,69 @@
+### Change log [2024-01-16 16:07:01]
+1. Item Updated: `gen_class_data` (from version: `1.2.0` to `1.2.0`)
+2. Item Updated: `churn_server` (from version: `1.1.0` to `1.1.0`)
+3. Item Updated: `v2_model_server` (from version: `1.1.0` to `1.1.0`)
+4. Item Updated: `xgb_custom` (from version: `1.1.0` to `1.1.0`)
+5. Item Updated: `concept_drift_streaming` (from version: `1.1.0` to `1.1.0`)
+6. Item Updated: `describe_dask` (from version: `1.1.0` to `1.1.0`)
+7. Item Updated: `xgb_test` (from version: `1.1.1` to `1.1.1`)
+8. Item Updated: `model_monitoring_stream` (from version: `1.1.0` to `1.1.0`)
+9. Item Updated: `model_server_tester` (from version: `1.1.0` to `1.1.0`)
+10. Item Updated: `open_archive` (from version: `1.1.0` to `1.1.0`)
+11. Item Updated: `github_utils` (from version: `1.1.0` to `1.1.0`)
+12. Item Updated: `load_dask` (from version: `1.1.0` to `1.1.0`)
+13. Item Updated: `structured_data_generator` (from version: `1.3.0` to `1.3.0`)
+14. Item Updated: `huggingface_auto_trainer` (from version: `1.0.0` to `1.0.0`)
+15. Item Updated: `sql_to_file` (from version: `1.1.0` to `1.1.0`)
+16. Item Updated: `xgb_trainer` (from version: `1.1.1` to `1.1.1`)
+17. Item Updated: `hugging_face_serving` (from version: `1.0.0` to `1.0.0`)
+18. Item Updated: `onnx_utils` (from version: `1.2.0` to `1.2.0`)
+19. Item Updated: `batch_inference` (from version: `1.7.0` to `1.7.0`)
+20. Item Updated: `hugging_face_classifier_trainer` (from version: `0.1.0` to `0.1.0`)
+21. New item created: `silero_vad` (version: `1.1.0`)
+22. Item Updated: `coxph_test` (from version: `1.1.0` to `1.1.0`)
+23. Item Updated: `describe_spark` (from version: `1.1.0` to `1.1.0`)
+24. Item Updated: `load_dataset` (from version: `1.1.0` to `1.1.0`)
+25. Item Updated: `auto_trainer` (from version: `1.6.0` to `1.6.0`)
+26. Item Updated: `v2_model_tester` (from version: `1.1.0` to `1.1.0`)
+27. Item Updated: `pii_recognizer` (from version: `0.2.0` to `0.2.0`)
+28. Item Updated: `validate_great_expectations` (from version: `1.1.0` to `1.1.0`)
+29. Item Updated: `bert_embeddings` (from version: `1.2.0` to `1.2.0`)
+30. Item Updated: `model_server` (from version: `1.1.0` to `1.1.0`)
+31. Item Updated: `pandas_profiling_report` (from version: `1.1.0` to `1.1.0`)
+32. Item Updated: `stream_to_parquet` (from version: `1.1.0` to `1.1.0`)
+33. Item Updated: `get_offline_features` (from version: `1.2.0` to `1.2.0`)
+34. Item Updated: `azureml_utils` (from version: `1.3.0` to `1.3.0`)
+35. Item Updated: `tf1_serving` (from version: `1.1.0` to `1.1.0`)
+36. Item Updated: `virtual_drift` (from version: `1.1.0` to `1.1.0`)
+37. Item Updated: `arc_to_parquet` (from version: `1.4.1` to `1.4.1`)
+38. Item Updated: `question_answering` (from version: `0.3.1` to `0.3.1`)
+39. Item Updated: `sklearn_classifier_dask` (from version: `1.1.1` to `1.1.1`)
+40. Item Updated: `feature_selection` (from version: `1.3.0` to `1.3.0`)
+41. Item Updated: `concept_drift` (from version: `1.1.0` to `1.1.0`)
+42. Item Updated: `test_classifier` (from version: `1.1.0` to `1.1.0`)
+43. Item Updated: `snowflake_dask` (from version: `1.1.0` to `1.1.0`)
+44. Item Updated: `feature_perms` (from version: `1.1.0` to `1.1.0`)
+45. Item Updated: `azureml_serving` (from version: `1.1.0` to `1.1.0`)
+46. Item Updated: `send_email` (from version: `1.2.0` to `1.2.0`)
+47. Item Updated: `batch_inference_v2` (from version: `2.2.0` to `2.2.0`)
+48. Item Updated: `model_monitoring_batch` (from version: `1.1.0` to `1.1.0`)
+49. Item Updated: `transcribe` (from version: `1.0.0` to `1.0.0`)
+50. Item Updated: `describe` (from version: `1.2.0` to `1.2.0`)
+51. Item Updated: `xgb_serving` (from version: `1.1.2` to `1.1.2`)
+52. Item Updated: `slack_notify` (from version: `1.1.0` to `1.1.0`)
+53. Item Updated: `text_to_audio_generator` (from version: `1.1.0` to `1.1.0`)
+54. Item Updated: `tf2_serving` (from version: `1.1.0` to `1.1.0`)
+55. Item Updated: `aggregate` (from version: `1.3.0` to `1.3.0`)
+56. Item Updated: `sklearn_classifier` (from version: `1.1.1` to `1.1.1`)
+57. Item Updated: `coxph_trainer` (from version: `1.1.0` to `1.1.0`)
+58. Item Updated: `rnn_serving` (from version: `1.1.0` to `1.1.0`)
+59. New item created: `pyannote_audio` (version: `1.0.0`)
+60. Item Updated: `tf2_serving_v2` (from version: `1.1.0` to `1.1.0`)
+61. Item Updated: `ingest` (from version: `1.1.0` to `1.1.0`)
+62. Item Updated: `translate` (from version: `0.0.2` to `0.0.2`)
+63. Item Removed: `speech_diarization`
+64. Item Removed: `speech_diarization`
+
 ### Change log [2023-12-28 09:03:47]
 1. Item Updated: `gen_class_data` (from version: `1.2.0` to `1.2.0`)
 2. Item Updated: `churn_server` (from version: `1.1.0` to `1.1.0`)

functions/development/pii_recognizer/0.2.0/src/data/config.csv

@@ -0,0 +1,3 @@
+input_file,output_file
+data/pii.txt,data/pii_out.txt
+data/letter.txt,data/letter_out.txt

functions/development/pii_recognizer/0.2.0/src/data/letter.txt

@@ -0,0 +1,12 @@
+Dear Mr. John Doe,
+
+We are pleased to inform you that you have been selected as the winner of our exclusive vacation package giveaway! Congratulations! You, along with your family, will enjoy a luxurious stay at our resort in the beautiful city of Riviera. Your flight tickets have been booked, and you will be departing on July 15th, 2023.
+
+Please provide us with the necessary details to finalize your travel arrangements. We kindly request your full name, date of birth, passport number, and contact information. Rest assured that all provided information will be handled with utmost confidentiality and in compliance with data protection regulations.
+
+We look forward to creating unforgettable memories for you and your loved ones during your stay with us. If you have any questions or require further assistance, please don't hesitate to contact our customer support team.
+
+Best regards,
+
+Jane Smith
+Customer Support Representative

functions/development/pii_recognizer/0.2.0/src/data/output/letter_output.txt

@@ -0,0 +1,12 @@
+Dear Mr. <PERSON>,
+
+We are pleased to inform you that you have been selected as the winner of our exclusive vacation package giveaway! Congratulations! You, along with your family, will enjoy a luxurious stay at our resort in the beautiful city of <LOCATION>. Your flight tickets have been booked, and you will be departing on July 15th, 2023.
+
+Please provide us with the necessary details to finalize your travel arrangements. We kindly request your full name, date of birth, passport number, and contact information. Rest assured that all provided information will be handled with utmost confidentiality and in compliance with data protection regulations.
+
+We look forward to creating unforgettable memories for you and your loved ones during your stay with us. If you have any questions or require further assistance, please don't hesitate to contact our customer support team.
+
+Best regards,
+
+<PERSON>
+<ORGANIZATION> Support <ORGANIZATION>

functions/development/pii_recognizer/0.2.0/src/data/output/pii_output.txt

@@ -0,0 +1 @@
+<PERSON> <ORGANIZATION> is <SSN>, connect him with <EMAIL> or <PHONE>, he can pay you with <CREDIT_CARD>

functions/development/pii_recognizer/0.2.0/src/data/pii.txt

@@ -0,0 +1 @@
+John smith's ssn is 182838483, connect him with [email protected] or 6288389029, he can pay you with 41482929939393

functions/development/pii_recognizer/0.2.0/src/item.yaml

@@ -0,0 +1,34 @@
+apiVersion: v1
+categories: 
+  - machine-learning
+  - data-preparation
+description: This function is used to recognize PII in a directory of text files
+doc: ''
+example: pii_recognizer.ipynb
+generationDate: 2023-08-15:10-24
+hidden: false
+icon: ''
+labels:
+  author: pgw
+maintainers: []
+marketplaceType: ''
+mlrunVersion: 1.4.0
+name: pii-recognizer
+platformVersion: 3.5.3
+spec:
+  filename: pii_recognizer.py
+  handler: recognize_pii
+  image: mlrun/mlrun
+  kind: job
+  requirements:
+   - nltk
+   - pandas
+   - presidio-anonymizer
+   - presidio-analyzer
+   - torch
+   - flair@git+https://github.com/flairNLP/flair.git@d4ed67bf663e4066517f00397412510d90043653
+   - st-annotated-text
+   - https://huggingface.co/beki/en_spacy_pii_distilbert/resolve/main/en_spacy_pii_distilbert-any-py3-none-any.whl
+url: ''
+version: 0.2.0
+test_valid: False