Skip to content
Merged
Show file tree
Hide file tree
Changes from 184 commits
Commits
Show all changes
203 commits
Select commit Hold shift + click to select a range
4ce3960
feat: add DataRetriever class for loading and filtering data from CSV…
chakravarthik27 Mar 16, 2025
5b03e1c
feat: add AMEGA class for clinical tests with response generation and…
chakravarthik27 Mar 16, 2025
c515e49
fix typo
chakravarthik27 Mar 17, 2025
5027d4d
fix: correct spelling of 'Clinical' in class names and method signatures
chakravarthik27 Mar 18, 2025
79a0b35
feat: implement AMEGASample class and enhance AMEGA transformation wi…
chakravarthik27 Mar 18, 2025
35710a4
feat: enhance AMEGA class with improved sample handling and progress …
chakravarthik27 Mar 18, 2025
3bf91ac
fix: update tqdm import to use auto for better compatibility across e…
chakravarthik27 Mar 18, 2025
25a4101
feat: add dataset_info method to DataRetriever for comprehensive data…
chakravarthik27 Mar 18, 2025
86687cb
fix: include case_id in results for enhanced response evaluation
chakravarthik27 Mar 18, 2025
f12110e
update the condition
chakravarthik27 Mar 19, 2025
369a05a
fix: streamline test type filtering and enhance AMEGA report generation
chakravarthik27 Mar 19, 2025
12c8a3d
fix: adjust column insertion index for report summary DataFrame
chakravarthik27 Mar 19, 2025
f21d4b5
fix: TypeError: '<' not supported between instances of 'int' and 'list'
chakravarthik27 Mar 19, 2025
d996cbc
Merge pull request #1188 from JohnSnowLabs/feature/implement-the-amega
chakravarthik27 Mar 19, 2025
a7fb936
fix: implement CSV file download and save functionality in DataRetriever
chakravarthik27 Mar 20, 2025
8866c3b
feat: add MedFuzz class for question-answering and text-generation ta…
chakravarthik27 Mar 21, 2025
c5c8a0b
feat: add TargetLLM class for clinical decision-making; implement mes…
chakravarthik27 Mar 21, 2025
62696e2
feat: enhance MedFuzz class with transformation and processing method…
chakravarthik27 Mar 25, 2025
d505c48
feat: enhance MedFuzz and TargetLLM classes with progress tracking an…
chakravarthik27 Mar 25, 2025
901f637
feat: enhance model handling with TypeVar support and improve error h…
chakravarthik27 Mar 31, 2025
993829d
feat: enhance MedFuzzSample class with improved context highlighting …
chakravarthik27 Apr 6, 2025
034d18d
Merge pull request #1190 from JohnSnowLabs/feature/implement-the-fuzz…
chakravarthik27 Apr 8, 2025
a04d4d8
feat: add ClinicalNoteSummary class and DialogueToSummarySample for d…
chakravarthik27 Apr 8, 2025
115a8a7
fix: liniting issue
chakravarthik27 Apr 8, 2025
d9ab209
feat: add dialogue field to Harness class and enhance DialogueToSumma…
chakravarthik27 Apr 9, 2025
399b889
feat: implement SummaryEval class for clinical summary evaluation and…
chakravarthik27 Apr 13, 2025
025ab01
fix: improve dataset file extension handling in ClinicalNoteSummary c…
chakravarthik27 Apr 13, 2025
90947c9
fix: add check for already evaluated status in DialogueToSummarySample
chakravarthik27 Apr 14, 2025
f98fe13
Refactor LLM evaluation and dataset handling
chakravarthik27 Apr 15, 2025
f8d98af
feat: add threshold attribute to DialogueToSummarySample and update e…
chakravarthik27 Apr 15, 2025
2f9fffb
update: enhancing by migrating pydantic v1 basemodel to v1
chakravarthik27 Apr 15, 2025
bb52314
fix: enhance type handling in predictions by adding Union support for…
chakravarthik27 Apr 15, 2025
a046afe
fix: update test_case type to support Union of str, int, and float in…
chakravarthik27 Apr 15, 2025
774773f
fix: replace sample.copy() with sample.model_copy() for dataset handl…
chakravarthik27 Apr 15, 2025
7ec3a75
fix: update BaseSample attributes to use Optional for better type han…
chakravarthik27 Apr 16, 2025
20a9aac
fix: correct threshold calculation in ClinicalNoteSummary to use min …
chakravarthik27 Apr 16, 2025
c4def03
feat: enhance evaluation logic in DialogueToSummarySample to support …
chakravarthik27 Apr 23, 2025
5c2a07c
fix: remove unused import of SummaryEval in sample.py
chakravarthik27 Apr 24, 2025
2ef15ef
Merge pull request #1194 from JohnSnowLabs/enhance/migrate-pydantic-m…
chakravarthik27 May 9, 2025
0f91bdf
feat: update threshold handling in DialogueToSummarySample for improv…
chakravarthik27 Jun 17, 2025
358a733
Merge remote-tracking branch 'origin/release/2.7.0' into feat/impleme…
chakravarthik27 Jun 17, 2025
6064aad
fix: change task field in DialogueToSummarySample to use Literal type…
chakravarthik27 Jun 17, 2025
ff529d3
feat: enhance clinical note summary generation and improve dialogue h…
chakravarthik27 Jun 18, 2025
218cf96
Merge pull request #1192 from JohnSnowLabs/feat/implement-mts-dialog-…
chakravarthik27 Jun 19, 2025
db49bd8
refactor: updated the poetry lock file.
chakravarthik27 Jun 25, 2025
1d42782
fix: remove optional torch dependency from pyproject.toml
chakravarthik27 Jun 25, 2025
926f92b
Add optional dependency for torch and update transformers extras in p…
chakravarthik27 Jun 27, 2025
7737d9c
Update dependencies in pyproject.toml
chakravarthik27 Jun 27, 2025
bacc716
Update dependencies in pyproject.toml
chakravarthik27 Jun 28, 2025
66130d2
Add databricks-langchain dependency and update extras in pyproject.toml
chakravarthik27 Jun 28, 2025
d391186
fix: update truncation parameter in text classification model
chakravarthik27 Jun 30, 2025
b4e41db
Merge pull request #1197 from JohnSnowLabs/fix/1196-fix-dependency-se…
chakravarthik27 Jun 30, 2025
14cbb7e
fix: enhance transformation handling in BiasTestFactory and update sa…
chakravarthik27 Jul 9, 2025
77e0fa0
fix: streamline parameter handling and improve readability in bias tr…
chakravarthik27 Jul 9, 2025
563295c
fix: avoid the fileExistsError by passing exist_ok=True
chakravarthik27 Jul 10, 2025
dfdd5df
fix: update resource handling in spacy_modelhandler and refactor conf…
chakravarthik27 Jul 14, 2025
8d239e2
Merge pull request #1199 from JohnSnowLabs/fix/1198-incompatibility-d…
chakravarthik27 Jul 14, 2025
2df2805
fix: base_url can add in model_parameters.
chakravarthik27 Jul 21, 2025
c2eb055
Merge pull request #1201 from JohnSnowLabs/fix/valueerror-in-azureopenai
chakravarthik27 Jul 21, 2025
b7e5624
feat: add support for randomized options in question-answering tasks
chakravarthik27 Jul 29, 2025
4c80017
fix: AttributeError: 'str' object has no attribute 'task'
chakravarthik27 Jul 30, 2025
5af1d55
fix: handle string samples in RandomizeOptions transformation
chakravarthik27 Jul 30, 2025
116f8c7
feat: add test for RandomizeOptions transformation
chakravarthik27 Jul 30, 2025
dffcb85
Merge pull request #1203 from Pacific-AI-Corp/feature/order-effects-i…
chakravarthik27 Jul 30, 2025
4804494
Update transformers dependency to version 4.52.1 in pyproject.toml
chakravarthik27 Jul 30, 2025
daabdf2
fix: update transformers version constraint to allow 4.54.1
chakravarthik27 Jul 30, 2025
3e7d96c
Update torch dependency version to 2.7.1 in pyproject.toml
chakravarthik27 Jul 30, 2025
377c8cf
Update johnsnowlabs dependency version to ^6.0.4 in pyproject.toml
chakravarthik27 Jul 30, 2025
34820fb
Updated the 'accelerate' dependency version from '0.34.2' to '^1.9.0'…
chakravarthik27 Jul 31, 2025
e13a962
fix: formatting issues in test_modelhandler.py
chakravarthik27 Jul 31, 2025
5cb753e
fix: improve error handling in try_import_lib and update test_harness…
chakravarthik27 Jul 31, 2025
1090d40
fix: downgrade johnsnowlabs dependency from 6.0.4 to 6.0.3 in pyproje…
chakravarthik27 Jul 31, 2025
bc77939
fix: upgrade the pyspark to 3.5.0 from tasks
chakravarthik27 Jul 31, 2025
9226c20
fix: downgrade pyspark dependency from 3.5.0 to 3.3.0 in extra-lib
chakravarthik27 Aug 1, 2025
749b309
fix: update pyspark dependency to 3.5.6 in extra-lib
chakravarthik27 Aug 1, 2025
6199b50
fix: update johnsnowlabs dependency to version 5.5.0 in pyproject.toml
chakravarthik27 Aug 1, 2025
b666cc4
fix: downgrade johnsnowlabs dependency from 6.0.4 to 5.5.5 in poetry.…
chakravarthik27 Aug 1, 2025
dffb059
fix: update johnsnowlabs dependency to be optional in pyproject.toml
chakravarthik27 Aug 1, 2025
7731bef
temp: commented the 4 jsl test cases
chakravarthik27 Aug 1, 2025
a45f16f
update: resources.files from resource_filename
chakravarthik27 Aug 5, 2025
acd1754
refactor: replace pkg_resources with importlib.resources for file han…
chakravarthik27 Aug 5, 2025
3a554a7
refactor: replace resource_filename with importlib.resources for impr…
chakravarthik27 Aug 5, 2025
204525a
fix: update path for config.yml in Harness class to reflect new direc…
chakravarthik27 Aug 5, 2025
52f7b09
refactor: convert resource paths to strings for consistency in file h…
chakravarthik27 Aug 5, 2025
64c57dd
fix: format and lint issues.
chakravarthik27 Aug 5, 2025
df35d26
refactor: remove commented-out code in Brand2Generic class for clarity
chakravarthik27 Aug 5, 2025
867bf31
Update tutorial links to reflect repository ownership change from Joh…
chakravarthik27 Aug 11, 2025
cf92ff5
fix: update permalink to use lowercase for consistency in security tu…
chakravarthik27 Aug 11, 2025
ba65762
refactor: update the notebook links inside .ipynb files
chakravarthik27 Aug 11, 2025
b8549bf
Merge pull request #1207 from Pacific-AI-Corp/refactor/deprecation-wa…
chakravarthik27 Aug 11, 2025
1653e2b
refactor: uncomment test methods in SparkNLPTestCase for better clarity
chakravarthik27 Aug 11, 2025
900cebe
fix: update johnsnowlabs dependency to version 6.0.4 and transformers…
chakravarthik27 Aug 11, 2025
c49dc67
fix: force-cpu-torch task to pyproject.toml
chakravarthik27 Aug 12, 2025
33d22c4
fix: update force-cpu-torch task to clear pip cache before showing to…
chakravarthik27 Aug 12, 2025
b3249a0
Update PyTorch dependency to version 2.8.0 with explicit source for C…
chakravarthik27 Aug 12, 2025
9d1ec98
fix: update force-cpu-torch task to display disk usage along with tor…
chakravarthik27 Aug 12, 2025
3535acb
fix: update Poetry version to 2.1.3 in GitHub Actions workflow
chakravarthik27 Aug 12, 2025
3b4f647
Merge pull request #1215 from Pacific-AI-Corp/update/1210-update-poet…
chakravarthik27 Aug 13, 2025
45b2514
Merge branch 'fix/vulnerabilities-and-upgrade-dependency-versions' of…
chakravarthik27 Aug 13, 2025
f1ad478
Merge remote-tracking branch 'origin/release/2.7.0' into fix/vulnerab…
chakravarthik27 Aug 13, 2025
788935f
fix: update Poetry version to 2.1.3 in build workflow
chakravarthik27 Aug 13, 2025
56ade4f
fix: upgrade pyspark installation in force-cpu-torch command
chakravarthik27 Aug 13, 2025
1049424
fix: updated the pyspark version 3.5.0
chakravarthik27 Aug 13, 2025
7d3c9d8
Update poetry.lock and pyproject.toml for johnsnowlabs dependency adj…
chakravarthik27 Aug 13, 2025
f740159
Add pyspark dependency to pyproject.toml
chakravarthik27 Aug 13, 2025
52c5a73
fix: remove virtual environment before installing dependencies
chakravarthik27 Aug 13, 2025
d9c23e1
fix: update dependency installation and improve error handling in lib…
chakravarthik27 Aug 13, 2025
c5af11d
fix: update mlflow version to 3.1.1 and add scipy as an optional depe…
chakravarthik27 Aug 13, 2025
69a3f4e
fix: lint and format issues
chakravarthik27 Aug 13, 2025
fd0b3cb
Update dependencies and markers in poetry.lock and pyproject.toml
chakravarthik27 Aug 13, 2025
994bee4
fix: correct path for pyspark removal and update force-cpu-torch comm…
chakravarthik27 Aug 13, 2025
f1c32e7
fix: update dataset version in pyproject.toml and refactor test cases…
chakravarthik27 Aug 14, 2025
7e36861
fix: remove unused HuggingFaceDataset parameterization in TestNERDataset
chakravarthik27 Aug 14, 2025
62492b1
fix: update pyspark version in force-cpu-torch command to 3.5.6
chakravarthik27 Aug 14, 2025
58fd85a
fix: uncomment the ner_jsl and text_classification_jsl tests
chakravarthik27 Aug 14, 2025
7e2bcfa
fix: update torch version specification to use caret for compatibility
chakravarthik27 Aug 15, 2025
343fda0
fix: add missing id for setup-python step in build workflow
chakravarthik27 Aug 15, 2025
d6729cd
fix: uncomment traceback printing in try_import_lib for better error …
chakravarthik27 Aug 15, 2025
f81b65b
fix: update pyspark version to 3.4.0 for compatibility
chakravarthik27 Aug 15, 2025
25610e7
fix: update force-cpu-torch command to remove pyspark directory befor…
chakravarthik27 Aug 15, 2025
9789508
fix: comment out traceback printing in try_import_lib for cleaner err…
chakravarthik27 Aug 18, 2025
66f0f2f
fix: comment out traceback import for cleaner code
chakravarthik27 Aug 18, 2025
b36973d
fix: update pyspark removal command to support multiple Python versions
chakravarthik27 Aug 18, 2025
10a206c
fix: update pyspark removal command to support wildcard Python versions
chakravarthik27 Aug 18, 2025
98cce93
fix: remove pyspark directory cleanup from force-cpu-torch command
chakravarthik27 Aug 18, 2025
67859e6
fix: update virtualenv path handling for Python version matrix in CI …
chakravarthik27 Aug 18, 2025
3df4a48
fix: standardize virtualenv path handling in CI workflow
chakravarthik27 Aug 18, 2025
ecfefd3
fix: update pyspark removal command to use specific Python version in…
chakravarthik27 Aug 18, 2025
df8aec6
fix: remove commented-out code from lib_manager and test_datasource f…
chakravarthik27 Aug 19, 2025
4616eda
Merge pull request #1205 from Pacific-AI-Corp/fix/vulnerabilities-and…
chakravarthik27 Aug 19, 2025
d70cad5
Implement code changes to enhance functionality and improve performance
chakravarthik27 Aug 25, 2025
b2fefed
Update tutorial links to reflect repository ownership change from Joh…
chakravarthik27 Aug 11, 2025
e2dfeeb
fix: update permalink to use lowercase for consistency in security tu…
chakravarthik27 Aug 11, 2025
880edb3
refactor: update the notebook links inside .ipynb files
chakravarthik27 Aug 11, 2025
ddd44d8
Implement code changes to enhance functionality and improve performance
chakravarthik27 Aug 25, 2025
e96f2cc
Merge branch 'refactor/replace-links-from-johnsnowlabs-to-pacific-ai-…
chakravarthik27 Aug 25, 2025
583ec85
updated: logo in Question-Answering notebook
chakravarthik27 Aug 25, 2025
483326d
updated: build workflow file.
chakravarthik27 Aug 25, 2025
ecb057d
feat: add MentalHealth class and enhance evaluation capabilities in c…
chakravarthik27 Aug 25, 2025
b1508eb
updated: poetry config in ci/cd
chakravarthik27 Aug 25, 2025
acd8aaa
updated: add cache clear in poetry
chakravarthik27 Aug 25, 2025
1935ff0
updated: no-cache flag for poetry install in ci/cd
chakravarthik27 Aug 25, 2025
00cbcc1
fix: poetry error
chakravarthik27 Aug 25, 2025
6b715e6
updated: cache clear with poetry
chakravarthik27 Aug 25, 2025
25f7dfc
updated: poetry.lock file
chakravarthik27 Aug 25, 2025
3e4d82d
updated: poetry.lock and workflow
chakravarthik27 Aug 25, 2025
be2a13e
fix: ensure proper cleanup of pyspark site-packages during installation
chakravarthik27 Aug 26, 2025
a7d896f
fix: refine pyspark uninstallation to target specific site-packages
chakravarthik27 Aug 26, 2025
1a26a40
fix: ensure pyspark uninstallation occurs in the activated virtual en…
chakravarthik27 Aug 26, 2025
97eb5f8
updated: notebooks from tutorials folder
chakravarthik27 Aug 26, 2025
9fde607
updated: notebooks from end-to-end-notebooks folder
chakravarthik27 Aug 26, 2025
a30f01d
add: include logo png image in assets
chakravarthik27 Aug 26, 2025
7fbfd2b
updated: logo in llm_notebooks folder - 1
chakravarthik27 Aug 26, 2025
7c91805
updated: logo links in llm_notebooks folder - 2
chakravarthik27 Aug 26, 2025
d68742d
updated: logo links in llm_notebook folder - 3
chakravarthik27 Aug 26, 2025
77c1476
updated: logo links from misc folder - 1
chakravarthik27 Aug 26, 2025
468612f
updated: logo links in misc folder - 2
chakravarthik27 Aug 26, 2025
5c53956
updated: logo links in RAG, test-specifc, and task-specific folders
chakravarthik27 Aug 26, 2025
145c830
updated: logo links in blogposts folder.
chakravarthik27 Aug 26, 2025
19abed0
updated: favicon and favicon.ico files; added jsl_fav.ico and jsl_fav…
chakravarthik27 Aug 26, 2025
1ffd818
updated: project metadata to reflect Pacific AI as the author and org…
chakravarthik27 Aug 26, 2025
8c2f74e
updated: added 'openrouter' to INSTALLED_HUBS and LANGCHAIN_HUBS; mod…
chakravarthik27 Aug 26, 2025
b19b2c1
feat: implement mental health evaluation metrics and integrate into e…
chakravarthik27 Sep 2, 2025
4d204db
fix: improve error handling and enhance sample selection in MentalHea…
chakravarthik27 Sep 2, 2025
c9f7862
refactor: format field definitions for improved readability in Consul…
chakravarthik27 Sep 2, 2025
d6d18c2
Merge pull request #1209 from Pacific-AI-Corp/refactor/replace-links-…
chakravarthik27 Sep 4, 2025
3213a8e
feat: add MentalHealth class and enhance evaluation capabilities in c…
chakravarthik27 Aug 25, 2025
5de455c
feat: implement mental health evaluation metrics and integrate into e…
chakravarthik27 Sep 2, 2025
90e7a22
fix: improve error handling and enhance sample selection in MentalHea…
chakravarthik27 Sep 2, 2025
53de446
refactor: format field definitions for improved readability in Consul…
chakravarthik27 Sep 2, 2025
c5e3128
Merge branch 'feature/implement-the-mentalchat16k-dataset-support-for…
chakravarthik27 Sep 4, 2025
f7cd35f
refactor: update SimplePrompt class attributes to use Optional types …
chakravarthik27 Sep 4, 2025
0399398
updated: add new notebook for Mental_Health
chakravarthik27 Sep 5, 2025
3440e40
fix: add initial state for Jupyter widgets in Mental Health notebook
chakravarthik27 Sep 8, 2025
652af13
refactor: MedFuzz class by removing commented code and enhancing ques…
chakravarthik27 Sep 8, 2025
f1a57cf
updated: new notebook for MedFuzz Test
chakravarthik27 Sep 8, 2025
3b76759
updated: add amega notebook
chakravarthik27 Sep 8, 2025
da194c1
updated: add notebook for randomize_options test. refactored the shuf…
chakravarthik27 Sep 8, 2025
4156d4a
updated: randomize_options notebook
chakravarthik27 Sep 8, 2025
88e7b11
refactor: enhance evaluation logic and scoring in LlmEval and Dialogu…
chakravarthik27 Sep 9, 2025
cb091db
updated: add notebooks for aci_bench and mts_dialog
chakravarthik27 Sep 9, 2025
f1d367c
updated: notebook link for amega
chakravarthik27 Sep 9, 2025
9d5c187
updated: change repository references from JohnSnowLabs to Pacific-AI…
chakravarthik27 Sep 9, 2025
9490563
Merge pull request #1218 from Pacific-AI-Corp/feature/implement-the-m…
chakravarthik27 Sep 9, 2025
0b893ae
update: bump version to 2.7.0 and add new data directories for MTSDia…
chakravarthik27 Sep 12, 2025
576dc0f
updated: free up additional disk space by removing cached files in bu…
chakravarthik27 Sep 15, 2025
a154804
updated: refine disk space cleanup by removing specific log files in …
chakravarthik27 Sep 15, 2025
6d31bef
updated: change build job to run on both ubuntu-latest and self-hoste…
chakravarthik27 Sep 15, 2025
fb107ca
updated: change build job to run on macos-latest instead of ubuntu-la…
chakravarthik27 Sep 15, 2025
87def83
updated: change build job to run on ubuntu-latest instead of macos-la…
chakravarthik27 Sep 15, 2025
ac2b8c4
refine disk space cleanup by removing specific log files and simplify…
chakravarthik27 Sep 15, 2025
7c6e135
update: change logo image source and add old logo for reference
chakravarthik27 Sep 16, 2025
dce5de5
update: change poetry version to 2.1.3 in release workflow
chakravarthik27 Sep 16, 2025
c3bbb8d
refine: suppress output during poetry dependency installation
chakravarthik27 Sep 16, 2025
625c5f5
refine: enhance poetry installation command for improved output handling
chakravarthik27 Sep 16, 2025
fcb3e92
refine: enhance disk space cleanup by removing additional directories
chakravarthik27 Sep 16, 2025
e948889
refine: update footer content with new copyright and policy links
chakravarthik27 Sep 18, 2025
d0548a6
updated: replace the githhub links with pacific-ai
chakravarthik27 Sep 18, 2025
2c1a482
updated: replaced the links with pacific.ai
chakravarthik27 Sep 18, 2025
7ad73cf
updated: links in the header and footer
chakravarthik27 Sep 18, 2025
0e1a9a5
Merge pull request #1221 from Pacific-AI-Corp/updates/websites-update…
chakravarthik27 Sep 18, 2025
d316128
updated: api documentation with pacific ai links
chakravarthik27 Sep 19, 2025
8f6ddaf
Merge pull request #1222 from Pacific-AI-Corp/updates/websites-update…
chakravarthik27 Sep 19, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 6 additions & 2 deletions .github/workflows/build_and_test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -28,13 +28,14 @@ jobs:

- uses: actions/checkout@v3
- name: Set up Python ${{ matrix.python-version }}
id: setup-python
uses: actions/setup-python@v3
with:
python-version: ${{ matrix.python-version }}

- uses: snok/install-poetry@v1
with:
version: 1.3.1
version: 2.1.3
virtualenvs-create: true
virtualenvs-in-project: true
installer-parallel: true
Expand All @@ -49,7 +50,10 @@ jobs:
- name: Install dependencies
if: steps.cached-poetry-dependencies.outputs.cache-hit != 'true'
run: |
poetry install --with dev --all-extras
poetry cache clear pypi --all -n
poetry install --with dev --all-extras --no-cache
source ./.venv/bin/activate && pip uninstall -y pyspark && rm -rf ./.venv/lib/python${{ matrix.python-version }}/site-packages/pyspark*/
pip install pyspark==3.5.6

- name: Check linting
run: |
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/llm_tests_build.yml
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ jobs:

- uses: snok/install-poetry@v1
with:
version: 1.3.1
version: 2.1.3
virtualenvs-create: true
virtualenvs-in-project: true
installer-parallel: true
Expand Down
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -203,3 +203,4 @@ tst_shortcut_sd/
src/*/resources/*.classes

_site/
mlruns
44 changes: 22 additions & 22 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,35 +7,35 @@
</div>

<p align="center">
<a href="https://github.com/JohnSnowLabs/langtest/releases">
<img alt="Release Notes" src="https://img.shields.io/github/v/release/johnsnowlabs/langtest.svg">
<a href="https://github.com/Pacific-AI-Corp/langtest/releases">
<img alt="Release Notes" src="https://img.shields.io/github/v/release/Pacific-AI-Corp/langtest.svg">
</a>
<a href="https://www.johnsnowlabs.com/responsible-ai-blog/">
<img alt="Blog" src="https://img.shields.io/badge/Responsible AI Blogs-8A2BE2">
</a>
<a href="https://langtest.org/docs/pages/docs/install">
<img alt="Documentation" src="https://img.shields.io/website?up_message=online&url=https%3A%2F%2Flangtest.org%2F">
</a>
<a href="https://star-history.com/#JohnSnowLabs/langtest">
<img alt="GitHub star chart" src="https://img.shields.io/github/stars/JohnSnowLabs/langtest?style=social">
<a href="https://star-history.com/#Pacific-AI-Corp/langtest">
<img alt="GitHub star chart" src="https://img.shields.io/github/stars/Pacific-AI-Corp/langtest?style=social">
</a>
<a href="https://github.com/JohnSnowLabs/langtest/issues">
<img alt="Open Issues" src="https://img.shields.io/github/issues-raw/JohnSnowLabs/langtest">
<a href="https://github.com/Pacific-AI-Corp/langtest/issues">
<img alt="Open Issues" src="https://img.shields.io/github/issues-raw/Pacific-AI-Corp/langtest">
</a>
<a href="https://pepy.tech/project/langtest">
<img alt="Downloads" src="https://static.pepy.tech/badge/langtest">
</a>
<a href="https://github.com/JohnSnowLabs/langtest/actions/workflows/build_and_test.yml">
<img alt="CI" src="https://github.com/JohnSnowLabs/langtest/actions/workflows/build_and_test.yml/badge.svg">
<a href="https://github.com/Pacific-AI-Corp/langtest/actions/workflows/build_and_test.yml">
<img alt="CI" src="https://github.com/Pacific-AI-Corp/langtest/actions/workflows/build_and_test.yml/badge.svg">
</a>
<a href="https://github.com/JohnSnowLabs/langtest/blob/master/LICENSE" alt="License">
<a href="https://github.com/Pacific-AI-Corp/langtest/blob/master/LICENSE" alt="License">
<img src="https://img.shields.io/badge/License-Apache%202.0-blue.svg" />
</a>
<a href="CODE_OF_CONDUCT.md">
<img alt="Contributor Covenant" src="https://img.shields.io/badge/Contributor%20Covenant-v2.0%20adopted-ff69b4.svg">
</a>

![Langtest Workflow](https://raw.githubusercontent.com/JohnSnowLabs/langtest/main/docs/assets/images/langtest/langtest_flow_graphic.jpeg)
![Langtest Workflow](https://raw.githubusercontent.com/Pacific-AI-Corp/langtest/main/docs/assets/images/langtest/langtest_flow_graphic.jpeg)

<p align="center">
<a href="https://langtest.org/">Project's Website</a> •
Expand Down Expand Up @@ -121,8 +121,8 @@ You can check out the following LangTest articles:
## Community Support

- [Slack](https://www.johnsnowlabs.com/slack-redirect/) For live discussion with the LangTest community, join the `#langtest` channel
- [GitHub](https://github.com/JohnSnowLabs/langtest/tree/main) For bug reports, feature requests, and contributions
- [Discussions](https://github.com/JohnSnowLabs/langtest/discussions) To engage with other community members, share ideas, and show off how you use LangTest!
- [GitHub](https://github.com/Pacific-AI-Corp/langtest/tree/main) For bug reports, feature requests, and contributions
- [Discussions](https://github.com/Pacific-AI-Corp/langtest/discussions) To engage with other community members, share ideas, and show off how you use LangTest!

## Mission

Expand All @@ -141,20 +141,20 @@ We propose here an early stage open-source community project that aims to fill t

We welcome all sorts of contributions:

- [Ideas](https://github.com/JohnSnowLabs/langtest/discussions/categories/ideas)
- [Discussions](https://github.com/JohnSnowLabs/langtest/discussions)
- [Feedback](https://github.com/JohnSnowLabs/langtest/discussions/categories/general)
- [Ideas](https://github.com/Pacific-AI-Corp/langtest/discussions/categories/ideas)
- [Discussions](https://github.com/Pacific-AI-Corp/langtest/discussions)
- [Feedback](https://github.com/Pacific-AI-Corp/langtest/discussions/categories/general)
- [Documentation](https://www.example.com/documentation)
- [Bug reports](https://www.example.com/bug-reports)

A detailed overview of contributing can be found in the **[contributing guide](https://github.com/JohnSnowLabs/langtest/blob/main/CONTRIBUTING.md)**.
A detailed overview of contributing can be found in the **[contributing guide](https://github.com/Pacific-AI-Corp/langtest/blob/main/CONTRIBUTING.md)**.

If you are looking to start working with the LangTest codebase, navigate to the GitHub ["issues"](https://github.com/JohnSnowLabs/langtest/issues) tab and start looking through interesting issues. There are a number of issues listed under where you could start out.
If you are looking to start working with the LangTest codebase, navigate to the GitHub ["issues"](https://github.com/Pacific-AI-Corp/langtest/issues) tab and start looking through interesting issues. There are a number of issues listed under where you could start out.
Or maybe through using LangTest you have an idea of your own or are looking for something in the documentation and thinking ‘This can be improved’...you can do something about it!

Feel free to ask questions on the [Q&A](https://github.com/JohnSnowLabs/langtest/discussions/categories/q-a) discussions.
Feel free to ask questions on the [Q&A](https://github.com/Pacific-AI-Corp/langtest/discussions/categories/q-a) discussions.

As contributors and maintainers to this project, you are expected to abide by LangTest's code of conduct. More information can be found at: [Contributor Code of Conduct](https://github.com/JohnSnowLabs/langtest/blob/release/1.8.0/CODE_OF_CONDUCT.md)
As contributors and maintainers to this project, you are expected to abide by LangTest's code of conduct. More information can be found at: [Contributor Code of Conduct](https://github.com/Pacific-AI-Corp/langtest/blob/release/1.8.0/CODE_OF_CONDUCT.md)


## Citation
Expand All @@ -178,11 +178,11 @@ the LangTest library:

We would like to acknowledge all contributors of this open-source community project.

<a href="https://github.com/johnsnowlabs/langtest/graphs/contributors">
<img src="https://contrib.rocks/image?repo=johnsnowlabs/langtest" />
<a href="https://github.com/Pacific-AI-Corp/langtest/graphs/contributors">
<img src="https://contrib.rocks/image?repo=Pacific-AI-Corp/langtest" />
</a>

## License

LangTest is released under the [Apache License 2.0](https://github.com/JohnSnowLabs/langtest/blob/main/LICENSE), which guarantees commercial use, modification, distribution, patent use, private use and sets limitations on trademark use, liability and warranty.
LangTest is released under the [Apache License 2.0](https://github.com/Pacific-AI-Corp/langtest/blob/main/LICENSE), which guarantees commercial use, modification, distribution, patent use, private use and sets limitations on trademark use, liability and warranty.

Large diffs are not rendered by default.

4 changes: 2 additions & 2 deletions demo/blogposts/KDnuggets_spacy_workflow.ipynb

Large diffs are not rendered by default.

4 changes: 2 additions & 2 deletions demo/tutorials/RAG/RAG_HF.ipynb

Large diffs are not rendered by default.

4 changes: 2 additions & 2 deletions demo/tutorials/RAG/RAG_OpenAI.ipynb

Large diffs are not rendered by default.

Large diffs are not rendered by default.

5 changes: 3 additions & 2 deletions demo/tutorials/benchmarks/Benchmarking_with_Harness.ipynb

Large diffs are not rendered by default.

5 changes: 3 additions & 2 deletions demo/tutorials/benchmarks/Langtest_Cli_Eval_Command.ipynb

Large diffs are not rendered by default.

5 changes: 3 additions & 2 deletions demo/tutorials/benchmarks/Question-Answering.ipynb

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Loading
Loading