Fix GitHub reindex #167
Merged
Fix GitHub reindex #167
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Squash migrations
- Introduce new model fields for website, YouTube, and PDF size limits - Update data source validation to use model-specific limits instead of global settings - Add corresponding migration for the new fields
- Remove hardcoded link_limit default values - Update function signatures to require explicit link_limit parameter - Use guru_type.website_count_limit for crawl link limit
- Add conditional reset for showCrawlInput and crawlUrl - Prevent unnecessary state updates when dialog is closed
- Add `last_successful_index_date` field to DataSource model - Improve error handling in GitHub repository update task - Provide more informative error messages for repository indexing failures - Update GitHub repository error formatting utility - Create migration for new DataSource field
- Update repository query to include both successful and failed data sources - Enhance repository indexing flexibility by expanding status filter
- Introduce `user_error` field in DataSource model to store user-friendly error messages - Update serializers to use new `user_error` field when formatting GitHub repository errors - Modify tasks to set both `error` and `user_error` during data source retrieval and GitHub repository updates - Create migration for the new `user_error` field - Enhance error handling utility to prioritize user-friendly error messages
- Refactor user error messages for GitHub repository indexing failures - Provide more context-specific and user-friendly error messages - Maintain existing indexing functionality while enhancing error communication - Simplify error message format to focus on key information
…ries - Modify `update_github_repositories` task to accept a `successful_repos` parameter - Create two distinct periodic tasks for processing successful and failed GitHub repositories - Adjust task frequency to handle successful and failed repositories differently - Improve repository update strategy with more granular task scheduling
- Add unique GitHub repository validation in GuruType model - Modify error handling to use dictionary-based ValidationError - Update error message formatting in views
- Add JSON parsing for github_repos input - Enhance error handling for GitHub repos validation - Propagate ValidationError in create_guru_type function
- Modify default github_repo_count_limit to 1 - Add migration to set existing GuruType instances to the new limit - Create corresponding migration to alter the field
- Introduce environment-based widget script configuration - Add dynamic base URL for self-hosted deployments - Include informative note for self-hosted users about base URL configuration - Minor text refinement in widget installation instructions
- Update inline comment for data-baseUrl to provide clearer guidance - Remove redundant note about base URL configuration - Simplify widget installation instructions
- Modify task to fetch GitHub details for only the first repository - Simplify error handling and logging for GitHub repo details - Maintain compatibility with existing code structure
- Add disabled state for the "Add Repository" button - Apply visual indication (opacity and cursor) when button is disabled - Prevent adding repositories during form submission or source processing
Task/pr fixes
- Log frequent tasks at a minimum interval of 1 hour.
Task/celery logs
Task/widget wildcard
Fix topic generation from github repos
Task/fix GitHub reindex
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.