-
Notifications
You must be signed in to change notification settings - Fork 7
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
8ed4687
commit fb9db62
Showing
38 changed files
with
544 additions
and
20 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
File renamed without changes.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
File renamed without changes.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
File renamed without changes.
28 changes: 28 additions & 0 deletions
28
examples/mockingbird/mockingbooks_py/twitter_analyze_like/mocks/api_call.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,28 @@ | ||
{ | ||
"retrievalStrID": "1709234668011517000", | ||
"retrievalID": 1709234668011517000, | ||
"retrievalName": "likes_llm_tweets", | ||
"retrievalGroup": "mockingbird_wai", | ||
"retrievalItemInstruction": { | ||
"retrievalPlatform": "api", | ||
"retrievalPrompt": "", | ||
"retrievalPlatformGroups": "", | ||
"retrievalKeywords": "", | ||
"retrievalUsernames": "", | ||
"discordFilters": { | ||
"categoryTopic": "", | ||
"categoryName": "", | ||
"category": "" | ||
}, | ||
"webFilters": { | ||
"routingGroup": "twitter-mockingbird_wai", | ||
"lbStrategy": "", | ||
"endpointRoutePath": "users/1752505182343286784/likes", | ||
"endpointREST": "post", | ||
"payloadPreProcessing": "iterate", | ||
"payloadKeys": [ | ||
"tweet_id" | ||
] | ||
} | ||
} | ||
} |
79 changes: 79 additions & 0 deletions
79
examples/mockingbird/mockingbooks_py/twitter_analyze_like/mocks/eval_fn_trigger.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,79 @@ | ||
{ | ||
"evalStrID": "1709235168313914137", | ||
"evalID": 1709235168313914137, | ||
"evalName": "like-tweets-mb", | ||
"evalType": "model", | ||
"evalGroupName": "twitter-mb", | ||
"evalModel": "gpt-3.5-turbo-0125", | ||
"evalFormat": "json", | ||
"triggerFunctions": [ | ||
{ | ||
"triggerStrID": "1709235049105085000", | ||
"triggerID": 1709235049105085000, | ||
"triggerName": "mb-likes-tweets", | ||
"triggerGroup": "twitter-mb", | ||
"triggerAction": "api-retrieval", | ||
"evalTriggerAction": { | ||
"evalTriggerState": "", | ||
"evalResultsTriggerOn": "" | ||
}, | ||
"evalTriggerActions": [ | ||
{ | ||
"evalStrID": "1709235168313914137", | ||
"triggerID": 1709235049105085000, | ||
"triggerStrID": "1709235049105085000", | ||
"evalTriggerState": "filter", | ||
"evalResultsTriggerOn": "all-pass" | ||
} | ||
] | ||
} | ||
], | ||
"schemas": [ | ||
{ | ||
"schemaID": 1709233769412026000, | ||
"schemaStrID": "1709233769412026000", | ||
"schemaName": "extract_relevant_tweets", | ||
"schemaGroup": "mockingbird", | ||
"schemaDescription": "This extracts tweet ids and calculates a spam score from 1-5.", | ||
"isObjArray": true, | ||
"fields": [ | ||
{ | ||
"fieldID": 1709243089471223000, | ||
"fieldStrID": "1709243089471223000", | ||
"fieldName": "tweet_id", | ||
"fieldDescription": "The analyzed id value.", | ||
"dataType": "string", | ||
"evalMetrics": [ | ||
{ | ||
"evalMetricID": 1709246063536426000, | ||
"evalOperator": "length-greater-than", | ||
"evalState": "filter", | ||
"evalExpectedResultState": "pass", | ||
"evalMetricComparisonValues": { | ||
"evalComparisonString": "10" | ||
} | ||
} | ||
] | ||
}, | ||
{ | ||
"fieldID": 1709245946134161000, | ||
"fieldStrID": "1709245946134161000", | ||
"fieldName": "msg_spam_score", | ||
"fieldDescription": "Score each message from 1-5 Scoring System Score 5: Likely Spam, Commercial, or Job Listing Contains phrases like \"Find unclaimed airdrops\", \"Start of the Year with a Big Pump\", or direct links to commercial products or services.Includes job listings or straightforward job-related announcements.Lacks personal interaction or conversational tone. Score 4: General Announcements or Basic Information Sharing Includes general updates or news without a clear invitation for discussion.May contain links to blogs, news articles, or general information about Kubernetes or related technology, but lacks personal engagement. Score 3: Mildly Engaging or Indirectly Inviting Interaction Tweets that share information with a slight personal touch or a hint of seeking interaction.Might include personal opinions or experiences related to Kubernetes, GitOps, or DevOps but doesn\u2019t actively seek responses. Score 2: Directly Engaging and Discussion Oriented Clearly seeks interaction by asking questions or soliciting opinions.Includes tweets that share experiences or problems related to Kubernetes, GitOps, LLMs, or DevOps with a clear invitation for advice or discussion. Score 1: Highly Interactive and Response-Oriented Directly asks for help, suggestions, or recommendations related to Kubernetes, GitOps, DevOps, MLOps, LLMs, or developer platforms. Demonstrates a clear intention to engage in a conversation or discussion.May include tweets responding to others' queries, offering advice, or sharing knowledge in an interactive manner. ", | ||
"dataType": "integer", | ||
"evalMetrics": [ | ||
{ | ||
"evalMetricID": 1709246063594665000, | ||
"evalOperator": "lt", | ||
"evalState": "filter", | ||
"evalExpectedResultState": "pass", | ||
"evalMetricComparisonValues": { | ||
"evalComparisonNumber": 4 | ||
} | ||
} | ||
] | ||
} | ||
] | ||
} | ||
] | ||
} |
24 changes: 24 additions & 0 deletions
24
examples/mockingbird/mockingbooks_py/twitter_analyze_like/mocks/retrieval_llm_tweets.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,24 @@ | ||
{ | ||
"retrievalStrID": "1709234959989201000", | ||
"retrievalID": 1709234959989201000, | ||
"retrievalName": "get_llm_tweets", | ||
"retrievalGroup": "mockingbird_wai", | ||
"retrievalItemInstruction": { | ||
"retrievalPlatform": "twitter", | ||
"retrievalPrompt": "", | ||
"retrievalPlatformGroups": "llm", | ||
"retrievalKeywords": "", | ||
"retrievalUsernames": "", | ||
"discordFilters": { | ||
"categoryTopic": "", | ||
"categoryName": "", | ||
"category": "" | ||
}, | ||
"webFilters": { | ||
"routingGroup": "", | ||
"lbStrategy": "", | ||
"endpointRoutePath": "", | ||
"endpointREST": "" | ||
} | ||
} | ||
} |
Oops, something went wrong.