Objects
Access
Fields
Name | Description |
---|---|
roles[RoleAssociation!] |
AccessToken
Fields
Name | Description |
---|---|
accessTokenString! | The access token itself |
metadataAccessTokenMetadata | Metadata about the generated token |
AccessTokenMetadata
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the access token | ||||
typeEntityType! | The standard Entity Type | ||||
idString! | The unique identifier of the token. | ||||
nameString! | The name of the token, if it exists. | ||||
descriptionString | The description of the token if defined. | ||||
actorUrnString! | The actor associated with the Access Token. | ||||
ownerUrnString! | The actor who created the Access Token. | ||||
createdAtLong! | The time when token was generated at. | ||||
expiresAtLong | Time when token will be expired. | ||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from this entity Arguments
|
Actor
Fields
Name | Description |
---|---|
users[RoleUser!] | List of users for which the role is provisioned |
ActorFilter
The actors that a DataHub Access Policy applies to
Fields
Name | Description |
---|---|
users[String!] | A disjunctive set of users to apply the policy to |
groups[String!] | A disjunctive set of groups to apply the policy to |
roles[String!] | A disjunctive set of roles to apply the policy to |
resourceOwnersBoolean! | Whether the filter should return TRUE for owners of a particular resource Only applies to policies of type METADATA, which have a resource associated with them |
resourceOwnersTypes[String!] | Set of OwnershipTypes to apply the policy to (if resourceOwners field is set to True) |
resolvedOwnershipTypes[OwnershipTypeEntity!] | Set of OwnershipTypes to apply the policy to (if resourceOwners field is set to True), resolved. |
allUsersBoolean! | Whether the filter should apply to all users |
allGroupsBoolean! | Whether the filter should apply to all groups |
resolvedUsers[CorpUser!] | The list of users on the Policy, resolved. |
resolvedGroups[CorpGroup!] | The list of groups on the Policy, resolved. |
resolvedRoles[DataHubRole!] | The list of roles on the Policy, resolved. |
AggregateResults
Results returned from aggregateAcrossEntities
Fields
Name | Description |
---|---|
facets[FacetMetadata!] | Candidate facet aggregations used for search filtering |
AggregationMetadata
Information about the aggregation that can be used for filtering, included the field value and number of results
Fields
Name | Description |
---|---|
valueString! | A particular value of a facet field |
countLong! | The number of search results containing the value |
entityEntity | Entity corresponding to the facet field |
AllowedValue
An entry for an allowed value for a structured property
Fields
Name | Description |
---|---|
valuePropertyValue! | The allowed value |
descriptionString | The description of this allowed value |
AnalyticsChartGroup
For consumption by UI only
Fields
Name | Description |
---|---|
groupIdString! | |
titleString! | |
charts[AnalyticsChart!]! |
AnalyticsConfig
Configurations related to the Analytics Feature
Fields
Name | Description |
---|---|
enabledBoolean! | Whether the Analytics feature is enabled and should be displayed |
AppConfig
Config loaded at application boot time This configuration dictates the behavior of the UI, such as which features are enabled or disabled
Fields
Name | Description |
---|---|
appVersionString | App version |
authConfigAuthConfig! | Auth-related configurations |
analyticsConfigAnalyticsConfig! | Configurations related to the Analytics Feature |
policiesConfigPoliciesConfig! | Configurations related to the Policies Feature |
identityManagementConfigIdentityManagementConfig! | Configurations related to the User & Group management |
managedIngestionConfigManagedIngestionConfig! | Configurations related to UI-based ingestion |
lineageConfigLineageConfig! | Configurations related to Lineage |
visualConfigVisualConfig! | Configurations related to visual appearance, allows styling the UI without rebuilding the bundle |
telemetryConfigTelemetryConfig! | Configurations related to tracking users in the app |
testsConfigTestsConfig! | Configurations related to DataHub tests |
viewsConfigViewsConfig! | Configurations related to DataHub Views |
featureFlagsFeatureFlagsConfig! | Feature flags telling the UI whether a feature is enabled or not |
AspectRenderSpec
Details for the frontend on how the raw aspect should be rendered
Fields
Name | Description |
---|---|
displayTypeString | Format the aspect should be displayed in for the UI. Powered by the renderSpec annotation on the aspect model |
displayNameString | Name to refer to the aspect type by for the UI. Powered by the renderSpec annotation on the aspect model |
keyString | Field in the aspect payload to index into for rendering. |
Assertion
An assertion represents a programmatic validation, check, or test performed periodically against another Entity.
Implements
Fields
Name | Description | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
actionsAssertionActions | The actions associated with the Assertion | ||||||||||||
urnString! | The primary key of the Assertion | ||||||||||||
typeEntityType! | The standard Entity Type | ||||||||||||
platformDataPlatform! | Standardized platform urn where the assertion is evaluated | ||||||||||||
infoAssertionInfo | Details about assertion | ||||||||||||
dataPlatformInstanceDataPlatformInstance | The specific instance of the data platform that this entity belongs to | ||||||||||||
runEventsAssertionRunEventsResult | Lifecycle events detailing individual runs of this assertion. If startTimeMillis & endTimeMillis are not provided, the most recent events will be returned. Arguments
| ||||||||||||
relationshipsEntityRelationshipsResult | Edges extending from this entity Arguments
| ||||||||||||
lineageEntityLineageResult | Edges extending from this entity grouped by direction in the lineage graph Arguments
| ||||||||||||
statusStatus | Status metadata of the assertion | ||||||||||||
tagsGlobalTags | The standard tags for the Assertion | ||||||||||||
aspects[RawAspect!] | Experimental API. For fetching extra aspects that do not have custom UI code yet Arguments
|
AssertionAction
An action associated with an assertion
Fields
Name | Description |
---|---|
typeAssertionActionType! | The type of the actions |
AssertionActions
Some actions associated with an assertion
Fields
Name | Description |
---|---|
onSuccess[AssertionAction!]! | Actions to be executed on successful assertion run. |
onFailure[AssertionAction!]! | Actions to be executed on failed assertion run. |
AssertionInfo
Type of assertion. Assertion types can evolve to span Datasets, Flows (Pipelines), Models, Features etc.
Fields
Name | Description |
---|---|
freshnessAssertionFreshnessAssertionInfo | Information about an Freshness Assertion |
volumeAssertionVolumeAssertionInfo | Information about an Volume Assertion |
sqlAssertionSqlAssertionInfo | Information about a SQL Assertion |
fieldAssertionFieldAssertionInfo | Information about a Field Assertion |
schemaAssertionSchemaAssertionInfo | Schema assertion, e.g. defining the expected structure for an asset. |
customAssertionCustomAssertionInfo | Information about Custom assertion |
sourceAssertionSource | The source or origin of the Assertion definition. |
lastUpdatedAuditStamp | The time that the status last changed and the actor who changed it |
typeAssertionType! | Top-level type of the assertion. |
datasetAssertionDatasetAssertionInfo | Dataset-specific assertion information |
descriptionString | An optional human-readable description of the assertion |
externalUrlString | URL where assertion details are available |
AssertionResult
The result of evaluating an assertion.
Fields
Name | Description |
---|---|
typeAssertionResultType! | The final result, e.g. either SUCCESS or FAILURE. |
rowCountLong | Number of rows for evaluated batch |
missingCountLong | Number of rows with missing value for evaluated batch |
unexpectedCountLong | Number of rows with unexpected value for evaluated batch |
actualAggValueFloat | Observed aggregate value for evaluated batch |
externalUrlString | URL where full results are available |
nativeResults[StringMapEntry!] | Native results / properties of evaluation |
errorAssertionResultError | Error details, if type is ERROR |
AssertionResultError
An error encountered when evaluating an AssertionResult
Fields
Name | Description |
---|---|
typeAssertionResultErrorType! | The type of error encountered |
properties[StringMapEntry!] | Additional metadata depending on the type of error |
AssertionRunEvent
An event representing an event in the assertion evaluation lifecycle.
Implements
Fields
Name | Description |
---|---|
timestampMillisLong! | The time at which the assertion was evaluated |
lastObservedMillisLong | The time at which the run event was last observed by the DataHub system - ie, when it was reported by external systems |
assertionUrnString! | Urn of assertion which is evaluated |
asserteeUrnString! | Urn of entity on which the assertion is applicable |
runIdString! | Native (platform-specific) identifier for this run |
statusAssertionRunStatus! | The status of the assertion run as per this timeseries event |
batchSpecBatchSpec | Specification of the batch which this run is evaluating |
partitionSpecPartitionSpec | Information about the partition that was evaluated |
runtimeContext[StringMapEntry!] | Runtime parameters of evaluation |
resultAssertionResult | Results of assertion, present if the status is COMPLETE |
AssertionRunEventsResult
Result returned when fetching run events for an assertion.
Fields
Name | Description |
---|---|
totalInt! | The total number of run events returned |
failedInt! | The number of failed run events |
succeededInt! | The number of succeeded run events |
erroredInt! | The number of errored run events |
runEvents[AssertionRunEvent!]! | The run events themselves |
AssertionSource
The source of an Assertion
Fields
Name | Description |
---|---|
typeAssertionSourceType! | The source type |
createdAuditStamp | The time at which the assertion was initially created and the actor who created it |
AssertionStdParameter
Parameter for AssertionStdOperator.
Fields
Name | Description |
---|---|
valueString! | The parameter value |
typeAssertionStdParameterType! | The type of the parameter |
AssertionStdParameters
Parameters for AssertionStdOperators
Fields
Name | Description |
---|---|
valueAssertionStdParameter | The value parameter of an assertion |
maxValueAssertionStdParameter | The maxValue parameter of an assertion |
minValueAssertionStdParameter | The minValue parameter of an assertion |
AuditStamp
A time stamp along with an optional actor
Fields
Name | Description |
---|---|
timeLong! | When the audited action took place |
actorString | Who performed the audited action |
AuthConfig
Configurations related to auth
Fields
Name | Description |
---|---|
tokenAuthEnabledBoolean! | Whether token-based auth is enabled. |
AuthenticatedUser
Information about the currently authenticated user
Fields
Name | Description |
---|---|
corpUserCorpUser! | The user information associated with the authenticated user, including properties used in rendering the profile |
platformPrivilegesPlatformPrivileges! | The privileges assigned to the currently authenticated user, which dictates which parts of the UI they should be able to use |
AutoCompleteMultipleResults
The results returned on a multi entity autocomplete query
Fields
Name | Description |
---|---|
queryString! | The raw query string |
suggestions[AutoCompleteResultForEntity!]! | The autocompletion suggestions |
AutoCompleteResultForEntity
An individual auto complete result specific to an individual Metadata Entity Type
Fields
Name | Description |
---|---|
typeEntityType! | Entity type |
suggestions[String!]! | The autocompletion results for specified entity type |
entities[Entity!]! | A list of entities to render in autocomplete |
AutoCompleteResults
The results returned on a single entity autocomplete query
Fields
Name | Description |
---|---|
queryString! | The query string |
suggestions[String!]! | The autocompletion results |
entities[Entity!]! | A list of entities to render in autocomplete |
BarChart
For consumption by UI only
Fields
Name | Description |
---|---|
titleString! | |
bars[NamedBar!]! |
BarSegment
For consumption by UI only
Fields
Name | Description |
---|---|
labelString! | |
valueInt! |
BaseData
Fields
Name | Description |
---|---|
datasetString! | Dataset used for the Training or Evaluation of the MLModel |
motivationString | Motivation to pick these datasets |
preProcessing[String!] | Details of Data Proprocessing |
BatchGetStepStatesResult
Result returned when fetching step state
Fields
Name | Description |
---|---|
results[StepStateResult!]! | The step states |
BatchSpec
Fields
Name | Description |
---|---|
nativeBatchIdString | The native identifier as specified by the system operating on the batch. |
queryString | A query that identifies a batch of data |
limitInt | Any limit to the number of rows in the batch, if applied |
customProperties[StringMapEntry!] | Custom properties of the Batch |
BatchUpdateStepStatesResult
Result returned when fetching step state
Fields
Name | Description |
---|---|
results[UpdateStepStateResult!]! | Results for each step |
BooleanBox
Fields
Name | Description |
---|---|
booleanValueBoolean! |
BrowsePath
A hierarchical entity path
Fields
Name | Description |
---|---|
path[String!]! | The components of the browse path |
BrowsePathEntry
Fields
Name | Description |
---|---|
nameString! | The path name of a group of browse results |
entityEntity | An optional entity associated with this browse entry. This will usually be a container entity. If this entity is not populated, the name must be used. |
BrowsePathV2
A hierarchical entity path V2
Fields
Name | Description |
---|---|
path[BrowsePathEntry!]! | The components of the browse path |
BrowseResultGroup
A group of Entities under a given browse path
Fields
Name | Description |
---|---|
nameString! | The path name of a group of browse results |
countLong! | The number of entities within the group |
BrowseResultGroupV2
A group of Entities under a given browse path
Fields
Name | Description |
---|---|
nameString! | The path name of a group of browse results |
entityEntity | An optional entity associated with this browse group. This will usually be a container entity. If this entity is not populated, the name must be used. |
countLong! | The number of entities within the group |
hasSubGroupsBoolean! | Whether or not there are any more groups underneath this group |
BrowseResultMetadata
Metadata about the Browse Paths response
Fields
Name | Description |
---|---|
path[String!]! | The provided path |
totalNumEntitiesLong! | The total number of entities under the provided browse path |
BrowseResults
The results of a browse path traversal query
Fields
Name | Description |
---|---|
entities[Entity!]! | The browse results |
groups[BrowseResultGroup!]! | The groups present at the provided browse path |
startInt! | The starting point of paginated results |
countInt! | The number of elements included in the results |
totalInt! | The total number of browse results under the path with filters applied |
metadataBrowseResultMetadata! | Metadata containing resulting browse groups |
BrowseResultsV2
The results of a browse path V2 traversal query
Fields
Name | Description |
---|---|
groups[BrowseResultGroupV2!]! | The groups present at the provided browse path V2 |
startInt! | The starting point of paginated results |
countInt! | The number of groups included in the results |
totalInt! | The total number of browse groups under the path with filters applied |
metadataBrowseResultMetadata! | Metadata containing resulting browse groups |
BusinessAttribute
A Business Attribute, or a logical schema Field
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the Data Product | ||||
typeEntityType! | A standard Entity Type | ||||
propertiesBusinessAttributeInfo | Properties about a Business Attribute | ||||
ownershipOwnership | Ownership metadata of the Business Attribute | ||||
institutionalMemoryInstitutionalMemory | References to internal resources related to Business Attribute | ||||
statusStatus | Status of the Dataset | ||||
relationshipsEntityRelationshipsResult | List of relationships between the source Entity and some destination entities with a given types Arguments
|
BusinessAttributeAssociation
Input required to attach business attribute to an entity
Fields
Name | Description |
---|---|
businessAttributeBusinessAttribute! | Business Attribute itself |
associatedUrnString! | Reference back to the associated urn for tracking purposes e.g. when sibling nodes are merged together |
BusinessAttributeInfo
Business Attribute type
Fields
Name | Description |
---|---|
nameString! | name of the business attribute |
descriptionString | description of business attribute |
tagsGlobalTags | Tags associated with the business attribute |
glossaryTermsGlossaryTerms | Glossary terms associated with the business attribute |
typeSchemaFieldDataType | Platform independent field type of the field |
customProperties[CustomPropertiesEntry!] | A list of platform specific metadata tuples |
createdAuditStamp! | An AuditStamp corresponding to the creation of this chart |
lastModifiedAuditStamp! | An AuditStamp corresponding to the modification of this chart |
deletedAuditStamp | An optional AuditStamp corresponding to the deletion of this chart |
BusinessAttributes
Business attributes attached to the metadata
Fields
Name | Description |
---|---|
businessAttributeBusinessAttributeAssociation | Business Attribute attached to the Metadata Entity |
CaveatDetails
Fields
Name | Description |
---|---|
needsFurtherTestingBoolean | Did the results suggest any further testing |
caveatDescriptionString | Caveat Description |
groupsNotRepresented[String!] | Relevant groups that were not represented in the evaluation dataset |
CaveatsAndRecommendations
Fields
Name | Description |
---|---|
caveatsCaveatDetails | Caveats on using this MLModel |
recommendationsString | Recommendations on where this MLModel should be used |
idealDatasetCharacteristics[String!] | Ideal characteristics of an evaluation dataset for this MLModel |
Cell
For consumption by UI only
Fields
Name | Description |
---|---|
valueString! | |
entityEntity | |
linkParamsLinkParams |
ChangeAuditStamps
Captures information about who created/last modified/deleted the entity and when
Fields
Name | Description |
---|---|
createdAuditStamp! | An AuditStamp corresponding to the creation |
lastModifiedAuditStamp! | An AuditStamp corresponding to the modification |
deletedAuditStamp | An optional AuditStamp corresponding to the deletion |
Chart
A Chart Metadata Entity
Implements
Fields
Name | Description | ||||||||
---|---|---|---|---|---|---|---|---|---|
urnString! | The primary key of the Chart | ||||||||
typeEntityType! | A standard Entity Type | ||||||||
lastIngestedLong | The timestamp for the last time this entity was ingested | ||||||||
containerContainer | The parent container in which the entity resides | ||||||||
parentContainersParentContainersResult | Recursively get the lineage of containers for this entity | ||||||||
toolString! | The chart tool name Note that this field will soon be deprecated in favor a unified notion of Data Platform | ||||||||
chartIdString! | An id unique within the charting tool | ||||||||
propertiesChartProperties | Additional read only properties about the Chart | ||||||||
editablePropertiesChartEditableProperties | Additional read write properties about the Chart | ||||||||
queryChartQuery | Info about the query which is used to render the chart | ||||||||
ownershipOwnership | Ownership metadata of the chart | ||||||||
statusStatus | Status metadata of the chart | ||||||||
deprecationDeprecation | The deprecation status of the chart | ||||||||
embedEmbed | Embed information about the Chart | ||||||||
tagsGlobalTags | The tags associated with the chart | ||||||||
institutionalMemoryInstitutionalMemory | References to internal resources related to the dashboard | ||||||||
glossaryTermsGlossaryTerms | The structured glossary terms associated with the dashboard | ||||||||
domainDomainAssociation | The Domain associated with the Chart | ||||||||
dataPlatformInstanceDataPlatformInstance | The specific instance of the data platform that this entity belongs to | ||||||||
statsSummaryChartStatsSummary | Not yet implemented. Experimental - Summary operational & usage statistics about a Chart | ||||||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from this entity Arguments
| ||||||||
lineageEntityLineageResult | Edges extending from this entity grouped by direction in the lineage graph Arguments
| ||||||||
browsePaths[BrowsePath!] | The browse paths corresponding to the chart. If no Browse Paths have been generated before, this will be null. | ||||||||
browsePathV2BrowsePathV2 | The browse path V2 corresponding to an entity. If no Browse Paths V2 have been generated before, this will be null. | ||||||||
infoChartInfo | Deprecated: No longer supported Deprecated, use properties field instead Additional read only information about the chart | ||||||||
editableInfoChartEditableProperties | Deprecated: No longer supported Deprecated, use editableProperties field instead Additional read write information about the Chart | ||||||||
globalTagsGlobalTags | Deprecated: No longer supported Deprecated, use tags instead The structured tags associated with the chart | ||||||||
platformDataPlatform! | Standardized platform urn where the chart is defined | ||||||||
inputFieldsInputFields | Input fields to power the chart | ||||||||
privilegesEntityPrivileges | Privileges given to a user relevant to this entity | ||||||||
existsBoolean | Whether or not this entity exists on DataHub | ||||||||
subTypesSubTypes | Sub Types that this entity implements | ||||||||
aspects[RawAspect!] | Experimental API. For fetching extra entities that do not have custom UI code yet Arguments
| ||||||||
structuredPropertiesStructuredProperties | Structured properties about this asset | ||||||||
health[Health!] | Experimental! The resolved health statuses of the asset | ||||||||
formsForms | The forms associated with the Dataset | ||||||||
incidentsEntityIncidentsResult | Incidents associated with the Chart Arguments
|
ChartCell
A Notebook cell which contains chart as content
Fields
Name | Description |
---|---|
cellTitleString! | Title of the cell |
cellIdString! | Unique id for the cell. |
changeAuditStampsChangeAuditStamps | Captures information about who created/last modified/deleted this TextCell and when |
ChartEditableProperties
Chart properties that are editable via the UI This represents logical metadata, as opposed to technical metadata
Fields
Name | Description |
---|---|
descriptionString | Description of the Chart |
ChartInfo
Deprecated, use ChartProperties instead Additional read only information about the chart
Fields
Name | Description |
---|---|
nameString! | Display name of the chart |
descriptionString | Description of the chart |
inputs[Dataset!] | Deprecated: No longer supported Deprecated, use relationship Consumes instead Data sources for the chart |
externalUrlString | Native platform URL of the chart |
typeChartType | Access level for the chart |
accessAccessLevel | Access level for the chart |
customProperties[CustomPropertiesEntry!] | A list of platform specific metadata tuples |
lastRefreshedLong | The time when this chart last refreshed |
createdAuditStamp! | An AuditStamp corresponding to the creation of this chart |
lastModifiedAuditStamp! | An AuditStamp corresponding to the modification of this chart |
deletedAuditStamp | An optional AuditStamp corresponding to the deletion of this chart |
ChartProperties
Additional read only properties about the chart
Fields
Name | Description |
---|---|
nameString! | Display name of the chart |
descriptionString | Description of the chart |
externalUrlString | Native platform URL of the chart |
typeChartType | Access level for the chart |
accessAccessLevel | Access level for the chart |
customProperties[CustomPropertiesEntry!] | A list of platform specific metadata tuples |
lastRefreshedLong | The time when this chart last refreshed |
createdAuditStamp! | An AuditStamp corresponding to the creation of this chart |
lastModifiedAuditStamp! | An AuditStamp corresponding to the modification of this chart |
deletedAuditStamp | An optional AuditStamp corresponding to the deletion of this chart |
ChartQuery
The query that was used to populate a Chart
Fields
Name | Description |
---|---|
rawQueryString! | Raw query to build a chart from input datasets |
typeChartQueryType! | The type of the chart query |
ChartStatsSummary
Experimental - subject to change. A summary of usage metrics about a Chart.
Fields
Name | Description |
---|---|
viewCountInt | The total view count for the chart |
viewCountLast30DaysInt | The view count in the last 30 days |
uniqueUserCountLast30DaysInt | The unique user count in the past 30 days |
topUsersLast30Days[CorpUser!] | The top users in the past 30 days |
Container
A container of other Metadata Entities
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the container | ||||
typeEntityType! | A standard Entity Type | ||||
lastIngestedLong | The timestamp for the last time this entity was ingested | ||||
platformDataPlatform! | Standardized platform. | ||||
containerContainer | Fetch an Entity Container by primary key (urn) | ||||
parentContainersParentContainersResult | Recursively get the lineage of containers for this entity | ||||
propertiesContainerProperties | Read-only properties that originate in the source data platform | ||||
editablePropertiesContainerEditableProperties | Read-write properties that originate in DataHub | ||||
ownershipOwnership | Ownership metadata of the dataset | ||||
institutionalMemoryInstitutionalMemory | References to internal resources related to the dataset | ||||
tagsGlobalTags | Tags used for searching dataset | ||||
glossaryTermsGlossaryTerms | The structured glossary terms associated with the dataset | ||||
subTypesSubTypes | Sub types of the container, e.g. "Database" etc | ||||
domainDomainAssociation | The Domain associated with the Dataset | ||||
deprecationDeprecation | The deprecation status of the container | ||||
dataPlatformInstanceDataPlatformInstance | The specific instance of the data platform that this entity belongs to | ||||
entitiesSearchResults | Children entities inside of the Container Arguments
| ||||
relationshipsEntityRelationshipsResult | Edges extending from this entity Arguments
| ||||
statusStatus | Status metadata of the container | ||||
existsBoolean | Whether or not this entity exists on DataHub | ||||
aspects[RawAspect!] | Experimental API. For fetching extra entities that do not have custom UI code yet Arguments
| ||||
structuredPropertiesStructuredProperties | Structured properties about this asset | ||||
formsForms | The forms associated with the Dataset | ||||
privilegesEntityPrivileges | Privileges given to a user relevant to this entity |
ContainerEditableProperties
Read-write properties that originate in DataHub
Fields
Name | Description |
---|---|
descriptionString | DataHub description of the Container |
ContainerProperties
Read-only properties that originate in the source data platform
Fields
Name | Description |
---|---|
nameString! | Display name of the Container |
descriptionString | System description of the Container |
customProperties[CustomPropertiesEntry!] | Custom properties of the Container |
externalUrlString | Native platform URL of the Container |
qualifiedNameString | Fully-qualified name of the Container |
ContentParams
Params about the recommended content
Fields
Name | Description |
---|---|
countLong | Number of entities corresponding to the recommended content |
CorpGroup
A DataHub Group entity, which represents a Person on the Metadata Entity Graph
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the group | ||||
typeEntityType! | A standard Entity Type | ||||
nameString! | Group name eg wherehows dev, ask_metadata | ||||
ownershipOwnership | Ownership metadata of the Corp Group | ||||
propertiesCorpGroupProperties | Additional read only properties about the group | ||||
editablePropertiesCorpGroupEditableProperties | Additional read write properties about the group | ||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from this entity Arguments
| ||||
originOrigin | Origin info about this group. | ||||
infoCorpGroupInfo | Deprecated: No longer supported Deprecated, use properties field instead Additional read only info about the group | ||||
existsBoolean | Whether or not this entity exists on DataHub | ||||
aspects[RawAspect!] | Experimental API. For fetching extra entities that do not have custom UI code yet Arguments
| ||||
structuredPropertiesStructuredProperties | Structured properties about this asset | ||||
formsForms | The forms associated with the Dataset | ||||
privilegesEntityPrivileges | Privileges given to a user relevant to this entity |
CorpGroupEditableProperties
Additional read write properties about a group
Fields
Name | Description |
---|---|
descriptionString | DataHub description of the group |
slackString | Slack handle for the group |
emailString | Email address for the group |
pictureLinkString | A URL which points to a picture which user wants to set as a profile photo |
CorpGroupInfo
Deprecated, use CorpUserProperties instead Additional read only info about a group
Fields
Name | Description |
---|---|
displayNameString | The name to display when rendering the group |
descriptionString | The description provided for the group |
emailString | email of this group |
admins[CorpUser!] | Deprecated: No longer supported Deprecated, do not use owners of this group |
members[CorpUser!] | Deprecated: No longer supported Deprecated, use relationship IsMemberOfGroup instead List of ldap urn in this group |
groups[String!] | Deprecated: No longer supported Deprecated, do not use List of groups urns in this group |
CorpGroupProperties
Additional read only properties about a group
Fields
Name | Description |
---|---|
displayNameString | display name of this group |
descriptionString | The description provided for the group |
emailString | email of this group |
slackString | Slack handle for the group |
CorpUser
A DataHub User entity, which represents a Person on the Metadata Entity Graph
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the user | ||||
typeEntityType! | The standard Entity Type | ||||
usernameString! | A username associated with the user This uniquely identifies the user within DataHub | ||||
propertiesCorpUserProperties | Additional read only properties about the corp user | ||||
editablePropertiesCorpUserEditableProperties | Read write properties about the corp user | ||||
statusCorpUserStatus | The status of the user | ||||
tagsGlobalTags | The tags associated with the user | ||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from this entity Arguments
| ||||
isNativeUserBoolean | Whether or not this user is a native DataHub user | ||||
infoCorpUserInfo | Deprecated: No longer supported Deprecated, use properties field instead Additional read only info about the corp user | ||||
editableInfoCorpUserEditableInfo | Deprecated: No longer supported Deprecated, use editableProperties field instead Read write info about the corp user | ||||
globalTagsGlobalTags | Deprecated: No longer supported Deprecated, use the tags field instead The structured tags associated with the user | ||||
existsBoolean | Whether or not this entity exists on DataHub | ||||
settingsCorpUserSettings | Settings that a user can customize through the datahub ui | ||||
aspects[RawAspect!] | Experimental API. For fetching extra aspects that do not have custom UI code yet Arguments
| ||||
structuredPropertiesStructuredProperties | Structured properties about this asset | ||||
formsForms | The forms associated with the Dataset | ||||
privilegesEntityPrivileges | Privileges given to a user relevant to this entity |
CorpUserAppearanceSettings
Settings that control look and feel of the DataHub UI for the user
Fields
Name | Description |
---|---|
showSimplifiedHomepageBoolean | Flag whether the user should see a homepage with only datasets, charts & dashboards. Intended for users who have less operational use cases for the datahub tool. |
CorpUserEditableInfo
Deprecated, use CorpUserEditableProperties instead Additional read write info about a user
Fields
Name | Description |
---|---|
displayNameString | Display name to show on DataHub |
titleString | Title to show on DataHub |
aboutMeString | About me section of the user |
teams[String!] | Teams that the user belongs to |
skills[String!] | Skills that the user possesses |
pictureLinkString | A URL which points to a picture which user wants to set as a profile photo |
CorpUserEditableProperties
Additional read write properties about a user
Fields
Name | Description |
---|---|
displayNameString | Display name to show on DataHub |
titleString | Title to show on DataHub |
aboutMeString | About me section of the user |
teams[String!] | Teams that the user belongs to |
skills[String!] | Skills that the user possesses |
pictureLinkString | A URL which points to a picture which user wants to set as a profile photo |
slackString | The slack handle of the user |
phoneString | Phone number for the user |
emailString | Email address for the user |
personaDataHubPersona | User persona, if present |
platforms[DataPlatform!] | Platforms commonly used by the user, if present. |
CorpUserInfo
Deprecated, use CorpUserProperties instead Additional read only info about a user
Fields
Name | Description |
---|---|
activeBoolean! | Whether the user is active |
displayNameString | Display name of the user |
emailString | Email address of the user |
titleString | Title of the user |
managerCorpUser | Direct manager of the user |
departmentIdLong | department id the user belong to |
departmentNameString | department name this user belong to |
firstNameString | first name of the user |
lastNameString | last name of the user |
fullNameString | Common name of this user, format is firstName plus lastName |
countryCodeString | two uppercase letters country code |
customProperties[CustomPropertiesEntry!] | Custom properties of the ldap |
CorpUserProperties
Additional read only properties about a user
Fields
Name | Description |
---|---|
activeBoolean! | Whether the user is active |
displayNameString | Display name of the user |
emailString | Email address of the user |
titleString | Title of the user |
managerCorpUser | Direct manager of the user |
departmentIdLong | department id the user belong to |
departmentNameString | department name this user belong to |
firstNameString | first name of the user |
lastNameString | last name of the user |
fullNameString | Common name of this user, format is firstName plus lastName |
countryCodeString | two uppercase letters country code |
customProperties[CustomPropertiesEntry!] | Custom properties of the ldap |
CorpUserSettings
Settings that a user can customize through the datahub ui
Fields
Name | Description |
---|---|
appearanceCorpUserAppearanceSettings | Settings that control look and feel of the DataHub UI for the user |
viewsCorpUserViewsSettings | Settings related to the DataHub Views feature |
CorpUserViewsSettings
Settings related to the Views feature of DataHub.
Fields
Name | Description |
---|---|
defaultViewDataHubView | The default view for the User. |
Cost
Fields
Name | Description |
---|---|
costTypeCostType! | Type of Cost Code |
costValueCostValue! | Code to which the Cost of this entity should be attributed to ie organizational cost ID |
CostValue
Fields
Name | Description |
---|---|
costIdFloat | Organizational Cost ID |
costCodeString | Organizational Cost Code |
CronSchedule
A cron schedule
Fields
Name | Description |
---|---|
cronString! | A cron-formatted execution interval, as a cron string, e.g. 1 * * * * |
timezoneString! | Timezone in which the cron interval applies, e.g. America/Los_Angeles |
CustomAssertionInfo
Information about a custom assertion
Fields
Name | Description |
---|---|
typeString! | The type of custom assertion. |
entityUrnString! | The entity targeted by this custom assertion. |
fieldSchemaFieldRef | The field serving as input to the assertion, if any. |
logicString | Logic comprising a raw, unstructured assertion. |
CustomPropertiesEntry
An entry in a custom properties map represented as a tuple
Fields
Name | Description |
---|---|
keyString! | The key of the map entry |
valueString | The value fo the map entry |
associatedUrnString! | The urn of the entity this property came from for tracking purposes e.g. when sibling nodes are merged together |
Dashboard
A Dashboard Metadata Entity
Implements
Fields
Name | Description | ||||||||
---|---|---|---|---|---|---|---|---|---|
urnString! | The primary key of the Dashboard | ||||||||
typeEntityType! | A standard Entity Type | ||||||||
lastIngestedLong | The timestamp for the last time this entity was ingested | ||||||||
containerContainer | The parent container in which the entity resides | ||||||||
parentContainersParentContainersResult | Recursively get the lineage of containers for this entity | ||||||||
toolString! | The dashboard tool name Note that this will soon be deprecated in favor of a standardized notion of Data Platform | ||||||||
dashboardIdString! | An id unique within the dashboard tool | ||||||||
propertiesDashboardProperties | Additional read only properties about the dashboard | ||||||||
editablePropertiesDashboardEditableProperties | Additional read write properties about the dashboard | ||||||||
ownershipOwnership | Ownership metadata of the dashboard | ||||||||
statusStatus | Status metadata of the dashboard | ||||||||
embedEmbed | Embed information about the Dashboard | ||||||||
deprecationDeprecation | The deprecation status of the dashboard | ||||||||
tagsGlobalTags | The tags associated with the dashboard | ||||||||
institutionalMemoryInstitutionalMemory | References to internal resources related to the dashboard | ||||||||
glossaryTermsGlossaryTerms | The structured glossary terms associated with the dashboard | ||||||||
domainDomainAssociation | The Domain associated with the Dashboard | ||||||||
dataPlatformInstanceDataPlatformInstance | The specific instance of the data platform that this entity belongs to | ||||||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from this entity Arguments
| ||||||||
lineageEntityLineageResult | Edges extending from this entity grouped by direction in the lineage graph Arguments
| ||||||||
browsePaths[BrowsePath!] | The browse paths corresponding to the dashboard. If no Browse Paths have been generated before, this will be null. | ||||||||
browsePathV2BrowsePathV2 | The browse path V2 corresponding to an entity. If no Browse Paths V2 have been generated before, this will be null. | ||||||||
usageStatsDashboardUsageQueryResult | Experimental (Subject to breaking change) -- Statistics about how this Dashboard is used Arguments
| ||||||||
statsSummaryDashboardStatsSummary | Experimental - Summary operational & usage statistics about a Dashboard | ||||||||
infoDashboardInfo | Deprecated: No longer supported Deprecated, use properties field instead Additional read only information about the dashboard | ||||||||
editableInfoDashboardEditableProperties | Deprecated: No longer supported Deprecated, use editableProperties instead Additional read write properties about the Dashboard | ||||||||
globalTagsGlobalTags | Deprecated: No longer supported Deprecated, use tags field instead The structured tags associated with the dashboard | ||||||||
platformDataPlatform! | Standardized platform urn where the dashboard is defined | ||||||||
inputFieldsInputFields | Input fields that power all the charts in the dashboard | ||||||||
subTypesSubTypes | Sub Types of the dashboard | ||||||||
privilegesEntityPrivileges | Privileges given to a user relevant to this entity | ||||||||
existsBoolean | Whether or not this entity exists on DataHub | ||||||||
aspects[RawAspect!] | Experimental API. For fetching extra entities that do not have custom UI code yet Arguments
| ||||||||
structuredPropertiesStructuredProperties | Structured properties about this asset | ||||||||
health[Health!] | Experimental! The resolved health statuses of the asset | ||||||||
formsForms | The forms associated with the Dataset | ||||||||
incidentsEntityIncidentsResult | Incidents associated with the Dashboard Arguments
|
DashboardEditableProperties
Dashboard properties that are editable via the UI This represents logical metadata, as opposed to technical metadata
Fields
Name | Description |
---|---|
descriptionString | Description of the Dashboard |
DashboardInfo
Deprecated, use DashboardProperties instead Additional read only info about a Dashboard
Fields
Name | Description |
---|---|
nameString! | Display of the dashboard |
descriptionString | Description of the dashboard |
charts[Chart!]! | Deprecated: No longer supported Deprecated, use relationship Contains instead Charts that comprise the dashboard |
externalUrlString | Native platform URL of the dashboard |
accessAccessLevel | Access level for the dashboard Note that this will soon be deprecated for low usage |
customProperties[CustomPropertiesEntry!] | A list of platform specific metadata tuples |
lastRefreshedLong | The time when this dashboard last refreshed |
createdAuditStamp! | An AuditStamp corresponding to the creation of this dashboard |
lastModifiedAuditStamp! | An AuditStamp corresponding to the modification of this dashboard |
deletedAuditStamp | An optional AuditStamp corresponding to the deletion of this dashboard |
DashboardProperties
Additional read only properties about a Dashboard
Fields
Name | Description |
---|---|
nameString! | Display of the dashboard |
descriptionString | Description of the dashboard |
externalUrlString | Native platform URL of the dashboard |
accessAccessLevel | Access level for the dashboard Note that this will soon be deprecated for low usage |
customProperties[CustomPropertiesEntry!] | A list of platform specific metadata tuples |
lastRefreshedLong | The time when this dashboard last refreshed |
createdAuditStamp! | An AuditStamp corresponding to the creation of this dashboard |
lastModifiedAuditStamp! | An AuditStamp corresponding to the modification of this dashboard |
deletedAuditStamp | An optional AuditStamp corresponding to the deletion of this dashboard |
DashboardStatsSummary
Experimental - subject to change. A summary of usage metrics about a Dashboard.
Fields
Name | Description |
---|---|
viewCountInt | The total view count for the dashboard |
viewCountLast30DaysInt | The view count in the last 30 days |
uniqueUserCountLast30DaysInt | The unique user count in the past 30 days |
topUsersLast30Days[CorpUser!] | The top users in the past 30 days |
DashboardUsageAggregation
An aggregation of Dashboard usage statistics
Fields
Name | Description |
---|---|
bucketLong | The time window start time |
durationWindowDuration | The time window span |
resourceString | The resource urn associated with the usage information, eg a Dashboard urn |
metricsDashboardUsageAggregationMetrics | The rolled up usage metrics |
DashboardUsageAggregationMetrics
Rolled up metrics about Dashboard usage over time
Fields
Name | Description |
---|---|
uniqueUserCountInt | The unique number of dashboard users within the time range |
viewsCountInt | The total number of dashboard views within the time range |
executionsCountInt | The total number of dashboard executions within the time range |
DashboardUsageMetrics
A set of absolute dashboard usage metrics
Implements
Fields
Name | Description |
---|---|
timestampMillisLong! | The time at which the metrics were reported |
favoritesCountInt | The total number of times dashboard has been favorited FIXME: Qualifies as Popularity Metric rather than Usage Metric? |
viewsCountInt | The total number of dashboard views |
executionsCountInt | The total number of dashboard execution |
lastViewedLong | The time when this dashboard was last viewed |
DashboardUsageQueryResult
The result of a dashboard usage query
Fields
Name | Description |
---|---|
buckets[DashboardUsageAggregation] | A set of relevant time windows for use in displaying usage statistics |
aggregationsDashboardUsageQueryResultAggregations | A set of rolled up aggregations about the dashboard usage |
metrics[DashboardUsageMetrics!] | A set of absolute dashboard usage metrics |
DashboardUsageQueryResultAggregations
A set of rolled up aggregations about the Dashboard usage
Fields
Name | Description |
---|---|
uniqueUserCountInt | The count of unique Dashboard users within the queried time range |
users[DashboardUserUsageCounts] | The specific per user usage counts within the queried time range |
viewsCountInt | The total number of dashboard views within the queried time range |
executionsCountInt | The total number of dashboard executions within the queried time range |
DashboardUserUsageCounts
Information about individual user usage of a Dashboard
Fields
Name | Description |
---|---|
userCorpUser | The user of the Dashboard |
viewsCountInt | number of times dashboard has been viewed by the user |
executionsCountInt | number of dashboard executions by the user |
usageCountInt | Normalized numeric metric representing user's dashboard usage Higher value represents more usage |
DataContract
A Data Contract Entity. A Data Contract is a verifiable group of assertions regarding various aspects of the data: its freshness (sla), schema, and data quality or validity. This group of assertions represents a data owner's commitment to producing data that confirms to the agreed upon contract. Each dataset can have a single contract. The contract can be in a "passing" or "violating" state, depending on whether the assertions that compose the contract are passing or failing. Note that the data contract entity is currently in early preview (beta).
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | A primary key of the data contract | ||||
typeEntityType! | The standard entity type | ||||
propertiesDataContractProperties | Properties describing the data contract | ||||
statusDataContractStatus | The status of the data contract | ||||
relationshipsEntityRelationshipsResult | List of relationships between the source Entity and some destination entities with a given types Arguments
|
DataContractProperties
Fields
Name | Description |
---|---|
entityUrnString! | The urn of the related entity, e.g. the Dataset today. In the future, we may support additional contract entities. |
freshness[FreshnessContract!] | The Freshness (SLA) portion of the contract. As of today, it is expected that there will not be more than 1 Freshness contract. If there are, only the first will be displayed. |
schema[SchemaContract!] | The schema / structural portion of the contract. As of today, it is expected that there will not be more than 1 Schema contract. If there are, only the first will be displayed. |
dataQuality[DataQualityContract!] | A set of data quality related contracts, e.g. table and column-level contract constraints. |
DataContractStatus
Fields
Name | Description |
---|---|
stateDataContractState! | The state of the data contract |
DataFlow
A Data Flow Metadata Entity, representing an set of pipelined Data Job or Tasks required to produce an output Dataset Also known as a Data Pipeline
Implements
Fields
Name | Description | ||||||||
---|---|---|---|---|---|---|---|---|---|
urnString! | The primary key of a Data Flow | ||||||||
typeEntityType! | A standard Entity Type | ||||||||
lastIngestedLong | The timestamp for the last time this entity was ingested | ||||||||
orchestratorString! | Workflow orchestrator ei Azkaban, Airflow | ||||||||
flowIdString! | Id of the flow | ||||||||
clusterString! | Cluster of the flow | ||||||||
propertiesDataFlowProperties | Additional read only properties about a Data flow | ||||||||
editablePropertiesDataFlowEditableProperties | Additional read write properties about a Data Flow | ||||||||
ownershipOwnership | Ownership metadata of the flow | ||||||||
tagsGlobalTags | The tags associated with the dataflow | ||||||||
statusStatus | Status metadata of the dataflow | ||||||||
deprecationDeprecation | The deprecation status of the Data Flow | ||||||||
institutionalMemoryInstitutionalMemory | References to internal resources related to the dashboard | ||||||||
glossaryTermsGlossaryTerms | The structured glossary terms associated with the dashboard | ||||||||
domainDomainAssociation | The Domain associated with the DataFlow | ||||||||
dataPlatformInstanceDataPlatformInstance | The specific instance of the data platform that this entity belongs to | ||||||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from this entity Arguments
| ||||||||
lineageEntityLineageResult | Edges extending from this entity grouped by direction in the lineage graph Arguments
| ||||||||
browsePaths[BrowsePath!] | The browse paths corresponding to the data flow. If no Browse Paths have been generated before, this will be null. | ||||||||
browsePathV2BrowsePathV2 | The browse path V2 corresponding to an entity. If no Browse Paths V2 have been generated before, this will be null. | ||||||||
infoDataFlowInfo | Deprecated: No longer supported Deprecated, use properties field instead Additional read only information about a Data flow | ||||||||
globalTagsGlobalTags | Deprecated: No longer supported Deprecated, use tags field instead The structured tags associated with the dataflow | ||||||||
dataJobsDataFlowDataJobsRelationships | Deprecated: No longer supported Deprecated, use relationship IsPartOf instead Data Jobs | ||||||||
platformDataPlatform! | Standardized platform urn where the datflow is defined | ||||||||
existsBoolean | Whether or not this entity exists on DataHub | ||||||||
aspects[RawAspect!] | Experimental API. For fetching extra entities that do not have custom UI code yet Arguments
| ||||||||
structuredPropertiesStructuredProperties | Structured properties about this asset | ||||||||
health[Health!] | Experimental! The resolved health statuses of the asset | ||||||||
formsForms | The forms associated with the Dataset | ||||||||
privilegesEntityPrivileges | Privileges given to a user relevant to this entity | ||||||||
incidentsEntityIncidentsResult | Incidents associated with the DataFlow Arguments
|
DataFlowDataJobsRelationships
Deprecated, use relationships query instead
Fields
Name | Description |
---|---|
entities[EntityRelationshipLegacy] |
DataFlowEditableProperties
Data Flow properties that are editable via the UI This represents logical metadata, as opposed to technical metadata
Fields
Name | Description |
---|---|
descriptionString | Description of the Data Flow |
DataFlowInfo
Deprecated, use DataFlowProperties instead Additional read only properties about a Data Flow aka Pipeline
Fields
Name | Description |
---|---|
nameString! | Display name of the flow |
descriptionString | Description of the flow |
projectString | Optional project or namespace associated with the flow |
externalUrlString | External URL associated with the DataFlow |
customProperties[CustomPropertiesEntry!] | A list of platform specific metadata tuples |
DataFlowProperties
Additional read only properties about a Data Flow aka Pipeline
Fields
Name | Description |
---|---|
nameString! | Display name of the flow |
descriptionString | Description of the flow |
projectString | Optional project or namespace associated with the flow |
externalUrlString | External URL associated with the DataFlow |
customProperties[CustomPropertiesEntry!] | A list of platform specific metadata tuples |
DataHubConnection
A connection between DataHub and an external Platform.
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The urn of the connection | ||||
typeEntityType! | The standard Entity Type field | ||||
detailsDataHubConnectionDetails! | The connection details | ||||
platformDataPlatform! | The external Data Platform associated with the connection | ||||
relationshipsEntityRelationshipsResult | Not implemented! Arguments
|
DataHubConnectionDetails
The details of the Connection
Fields
Name | Description |
---|---|
typeDataHubConnectionDetailsType! | The type or format of connection |
jsonDataHubJsonConnection | A JSON-encoded connection. Present when type is JSON. |
nameString | The name for this DataHub connection |
DataHubJsonConnection
The details of a JSON Connection
Fields
Name | Description |
---|---|
blobString! | The JSON blob containing the specific connection details. |
DataHubPersona
A standardized type of a user
Fields
Name | Description |
---|---|
urnString! | The urn of the persona type |
DataHubPolicy
An DataHub Platform Access Policy - Policies determine who can perform what actions against which resources on the platform
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the Policy | ||||
typeEntityType! | The standard Entity Type | ||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from the Role Arguments
| ||||
policyTypePolicyType! | The type of the Policy | ||||
nameString! | The name of the Policy | ||||
statePolicyState! | The present state of the Policy | ||||
descriptionString | The description of the Policy | ||||
resourcesResourceFilter | The resources that the Policy privileges apply to | ||||
privileges[String!]! | The privileges that the Policy grants | ||||
actorsActorFilter! | The actors that the Policy grants privileges to | ||||
editableBoolean! | Whether the Policy is editable, ie system policies, or not |
DataHubRole
A DataHub Role is a high-level abstraction on top of Policies that dictates what actions users can take.
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the role | ||||
typeEntityType! | The standard Entity Type | ||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from the Role Arguments
| ||||
nameString! | The name of the Role. | ||||
descriptionString! | The description of the Role | ||||
aspects[RawAspect!] | Experimental API. For fetching extra entities that do not have custom UI code yet Arguments
|
DataHubView
An DataHub View - Filters that are applied across the application automatically.
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the View | ||||
typeEntityType! | The standard Entity Type | ||||
viewTypeDataHubViewType! | The type of the View | ||||
nameString! | The name of the View | ||||
descriptionString | The description of the View | ||||
definitionDataHubViewDefinition! | The definition of the View | ||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from the View Arguments
|
DataHubViewDefinition
An DataHub View Definition
Fields
Name | Description |
---|---|
entityTypes[EntityType!]! | A set of filters to apply. If left empty, then ALL entity types are in scope. |
filterDataHubViewFilter! | A set of filters to apply. If left empty, then no filters will be applied. |
DataHubViewFilter
A DataHub View Filter. Note that
Fields
Name | Description |
---|---|
operatorLogicalOperator! | The operator used to combine the filters. |
filters[FacetFilter!]! | A set of filters combined using the operator. If left empty, then no filters will be applied. |
DataJob
A Data Job Metadata Entity, representing an individual unit of computation or Task to produce an output Dataset Always part of a parent Data Flow aka Pipeline
Implements
Fields
Name | Description | ||||||||
---|---|---|---|---|---|---|---|---|---|
urnString! | The primary key of the Data Job | ||||||||
typeEntityType! | A standard Entity Type | ||||||||
subTypesSubTypes | Sub Types that this entity implements | ||||||||
lastIngestedLong | The timestamp for the last time this entity was ingested | ||||||||
dataFlowDataFlow | Deprecated, use relationship IsPartOf instead The associated data flow | ||||||||
jobIdString! | Id of the job | ||||||||
propertiesDataJobProperties | Additional read only properties associated with the Data Job | ||||||||
dataPlatformInstanceDataPlatformInstance | The specific instance of the data platform that this entity belongs to | ||||||||
editablePropertiesDataJobEditableProperties | Additional read write properties associated with the Data Job | ||||||||
tagsGlobalTags | The tags associated with the DataJob | ||||||||
ownershipOwnership | Ownership metadata of the job | ||||||||
statusStatus | Status metadata of the DataJob | ||||||||
deprecationDeprecation | The deprecation status of the Data Flow | ||||||||
institutionalMemoryInstitutionalMemory | References to internal resources related to the dashboard | ||||||||
glossaryTermsGlossaryTerms | The structured glossary terms associated with the dashboard | ||||||||
domainDomainAssociation | The Domain associated with the Data Job | ||||||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from this entity Arguments
| ||||||||
lineageEntityLineageResult | Edges extending from this entity grouped by direction in the lineage graph Arguments
| ||||||||
browsePaths[BrowsePath!] | The browse paths corresponding to the data job. If no Browse Paths have been generated before, this will be null. | ||||||||
browsePathV2BrowsePathV2 | The browse path V2 corresponding to an entity. If no Browse Paths V2 have been generated before, this will be null. | ||||||||
infoDataJobInfo | Deprecated: No longer supported Deprecated, use properties field instead Additional read only information about a Data processing job | ||||||||
inputOutputDataJobInputOutput | Information about the inputs and outputs of a Data processing job including column-level lineage. | ||||||||
globalTagsGlobalTags | Deprecated: No longer supported Deprecated, use the tags field instead The structured tags associated with the DataJob | ||||||||
runsDataProcessInstanceResult | History of runs of this task Arguments
| ||||||||
privilegesEntityPrivileges | Privileges given to a user relevant to this entity | ||||||||
existsBoolean | Whether or not this entity exists on DataHub | ||||||||
aspects[RawAspect!] | Experimental API. For fetching extra entities that do not have custom UI code yet Arguments
| ||||||||
structuredPropertiesStructuredProperties | Structured properties about this asset | ||||||||
health[Health!] | Experimental! The resolved health statuses of the asset | ||||||||
formsForms | The forms associated with the Dataset | ||||||||
incidentsEntityIncidentsResult | Incidents associated with the DataJob Arguments
|
DataJobEditableProperties
Data Job properties that are editable via the UI This represents logical metadata, as opposed to technical metadata
Fields
Name | Description |
---|---|
descriptionString | Description of the Data Job |
DataJobInfo
Deprecated, use DataJobProperties instead Additional read only information about a Data Job aka Task
Fields
Name | Description |
---|---|
nameString! | Job display name |
descriptionString | Job description |
externalUrlString | External URL associated with the DataJob |
customProperties[CustomPropertiesEntry!] | A list of platform specific metadata tuples |
DataJobInputOutput
The lineage information for a DataJob TODO Rename this to align with other Lineage models
Fields
Name | Description |
---|---|
inputDatasets[Dataset!] | Deprecated: No longer supported Deprecated, use relationship Consumes instead Input datasets produced by the data job during processing |
outputDatasets[Dataset!] | Deprecated: No longer supported Deprecated, use relationship Produces instead Output datasets produced by the data job during processing |
inputDatajobs[DataJob!] | Deprecated: No longer supported Deprecated, use relationship DownstreamOf instead Input datajobs that this data job depends on |
fineGrainedLineages[FineGrainedLineage!] | Lineage information for the column-level. Includes a list of objects detailing which columns are upstream and which are downstream of each other. The upstream and downstream columns are from datasets. |
DataJobProperties
Additional read only properties about a Data Job aka Task
Fields
Name | Description |
---|---|
nameString! | Job display name |
descriptionString | Job description |
externalUrlString | External URL associated with the DataJob |
customProperties[CustomPropertiesEntry!] | A list of platform specific metadata tuples |
DataPlatform
A Data Platform represents a specific third party Data System or Tool Examples include warehouses like Snowflake, orchestrators like Airflow, and dashboarding tools like Looker
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | Urn of the data platform | ||||
typeEntityType! | A standard Entity Type | ||||
lastIngestedLong | The timestamp for the last time this entity was ingested | ||||
nameString! | Name of the data platform | ||||
propertiesDataPlatformProperties | Additional read only properties associated with a data platform | ||||
displayNameString | Deprecated: No longer supported Deprecated, use properties displayName instead Display name of the data platform | ||||
infoDataPlatformInfo | Deprecated: No longer supported Deprecated, use properties field instead Additional properties associated with a data platform | ||||
relationshipsEntityRelationshipsResult | Edges extending from this entity Arguments
|
DataPlatformInfo
Deprecated, use DataPlatformProperties instead Additional read only information about a Data Platform
Fields
Name | Description |
---|---|
typePlatformType! | The platform category |
displayNameString | Display name associated with the platform |
datasetNameDelimiterString! | The delimiter in the dataset names on the data platform |
logoUrlString | A logo URL associated with the platform |
DataPlatformInstance
A Data Platform instance represents an instance of a 3rd party platform like Looker, Snowflake, etc.
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | Urn of the data platform | ||||
typeEntityType! | A standard Entity Type | ||||
platformDataPlatform! | Name of the data platform | ||||
instanceIdString! | The platform instance id | ||||
relationshipsEntityRelationshipsResult | Edges extending from this entity Arguments
| ||||
propertiesDataPlatformInstanceProperties | Additional read only properties associated with a data platform instance | ||||
ownershipOwnership | Ownership metadata of the data platform instance | ||||
institutionalMemoryInstitutionalMemory | References to internal resources related to the data platform instance | ||||
tagsGlobalTags | Tags used for searching the data platform instance | ||||
deprecationDeprecation | The deprecation status of the data platform instance | ||||
statusStatus | Status metadata of the container |
DataPlatformInstanceProperties
Additional read only properties about a DataPlatformInstance
Fields
Name | Description |
---|---|
nameString | The name of the data platform instance used in display |
descriptionString | Read only technical description for the data platform instance |
customProperties[CustomPropertiesEntry!] | Custom properties of the data platform instance |
externalUrlString | External URL associated with the data platform instance |
DataPlatformProperties
Additional read only properties about a Data Platform
Fields
Name | Description |
---|---|
typePlatformType! | The platform category |
displayNameString | Display name associated with the platform |
datasetNameDelimiterString! | The delimiter in the dataset names on the data platform |
logoUrlString | A logo URL associated with the platform |
DataProcessInstance
A DataProcessInstance Metadata Entity, representing an individual run of a task or datajob.
Implements
Fields
Name | Description | ||||||||
---|---|---|---|---|---|---|---|---|---|
urnString! | The primary key of the DataProcessInstance | ||||||||
typeEntityType! | The standard Entity Type | ||||||||
state[DataProcessRunEvent] | The history of state changes for the run Arguments
| ||||||||
createdAuditStamp | When the run was kicked off | ||||||||
nameString | The name of the data process | ||||||||
relationshipsEntityRelationshipsResult | Edges extending from this entity. In the UI, used for inputs, outputs and parentTemplate Arguments
| ||||||||
lineageEntityLineageResult | Edges extending from this entity grouped by direction in the lineage graph Arguments
| ||||||||
externalUrlString | The link to view the task run in the source system |
DataProcessInstanceResult
Data Process instances that match the provided query
Fields
Name | Description |
---|---|
countInt | The number of entities to include in result set |
startInt | The offset of the result set |
totalInt | The total number of run events returned |
runs[DataProcessInstance] | The data process instances that produced or consumed the entity |
DataProcessInstanceRunResult
the result of a run, part of the run state
Fields
Name | Description |
---|---|
resultTypeDataProcessInstanceRunResultType | The outcome of the run |
nativeResultTypeString | The outcome of the run in the data platforms native language |
DataProcessRunEvent
A state change event in the data process instance lifecycle
Implements
Fields
Name | Description |
---|---|
statusDataProcessRunStatus | The status of the data process instance |
attemptInt | The try number that this instance run is in |
resultDataProcessInstanceRunResult | The result of a run |
timestampMillisLong! | The timestamp associated with the run event in milliseconds |
durationMillisLong | The duration of the run in milliseconds |
DataProduct
A Data Product, or a logical grouping of Metadata Entities
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the Data Product | ||||
typeEntityType! | A standard Entity Type | ||||
propertiesDataProductProperties | Properties about a Data Product | ||||
ownershipOwnership | Ownership metadata of the Data Product | ||||
institutionalMemoryInstitutionalMemory | References to internal resources related to the Data Product | ||||
relationshipsEntityRelationshipsResult | Edges extending from this entity Arguments
| ||||
entitiesSearchResults | Children entities inside of the DataProduct Arguments
| ||||
glossaryTermsGlossaryTerms | The structured glossary terms associated with the Data Product | ||||
domainDomainAssociation | The Domain associated with the Data Product | ||||
tagsGlobalTags | Tags used for searching Data Product | ||||
aspects[RawAspect!] | Experimental API. For fetching extra entities that do not have custom UI code yet Arguments
| ||||
structuredPropertiesStructuredProperties | Structured properties about this asset | ||||
formsForms | The forms associated with the Dataset | ||||
privilegesEntityPrivileges | Privileges given to a user relevant to this entity |
DataProductProperties
Properties about a domain
Fields
Name | Description |
---|---|
nameString! | Display name of the Data Product |
descriptionString | Description of the Data Product |
externalUrlString | External URL for the DataProduct (most likely GitHub repo where Data Products are managed as code) |
numAssetsInt | Number of children entities inside of the Data Product. This number includes soft deleted entities. |
customProperties[CustomPropertiesEntry!] | Custom properties of the Data Product |
DataQualityContract
Fields
Name | Description |
---|---|
assertionAssertion! | The assertion representing the schema contract. |
Dataset
A Dataset entity, which encompasses Relational Tables, Document store collections, streaming topics, and other sets of data having an independent lifecycle
Implements
Fields
Name | Description | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|
contractDataContract | An optional Data Contract defined for the Dataset. | ||||||||||
urnString! | The primary key of the Dataset | ||||||||||
typeEntityType! | The standard Entity Type | ||||||||||
lastIngestedLong | The timestamp for the last time this entity was ingested | ||||||||||
platformDataPlatform! | Standardized platform urn where the dataset is defined | ||||||||||
containerContainer | The parent container in which the entity resides | ||||||||||
parentContainersParentContainersResult | Recursively get the lineage of containers for this entity | ||||||||||
nameString! | Unique guid for dataset No longer to be used as the Dataset display name. Use properties.name instead | ||||||||||
propertiesDatasetProperties | An additional set of read only properties | ||||||||||
editablePropertiesDatasetEditableProperties | An additional set of of read write properties | ||||||||||
ownershipOwnership | Ownership metadata of the dataset | ||||||||||
deprecationDeprecation | The deprecation status of the dataset | ||||||||||
institutionalMemoryInstitutionalMemory | References to internal resources related to the dataset | ||||||||||
schemaMetadataSchemaMetadata | Schema metadata of the dataset, available by version number Arguments
| ||||||||||
editableSchemaMetadataEditableSchemaMetadata | Editable schema metadata of the dataset | ||||||||||
statusStatus | Status of the Dataset | ||||||||||
embedEmbed | Embed information about the Dataset | ||||||||||
tagsGlobalTags | Tags used for searching dataset | ||||||||||
glossaryTermsGlossaryTerms | The structured glossary terms associated with the dataset | ||||||||||
dataPlatformInstanceDataPlatformInstance | The specific instance of the data platform that this entity belongs to | ||||||||||
domainDomainAssociation | The Domain associated with the Dataset | ||||||||||
formsForms | The forms associated with the Dataset | ||||||||||
accessAccess | The Roles and the properties to access the dataset | ||||||||||
usageStatsUsageQueryResult | Statistics about how this Dataset is used The first parameter, Arguments
| ||||||||||
statsSummaryDatasetStatsSummary | Experimental - Summary operational & usage statistics about a Dataset | ||||||||||
datasetProfiles[DatasetProfile!] | Profile Stats resource that retrieves the events in a previous unit of time in descending order If no start or end time are provided, the most recent events will be returned Arguments
| ||||||||||
operations[Operation!] | Operational events for an entity. Arguments
| ||||||||||
assertionsEntityAssertionsResult | Assertions associated with the Dataset Arguments
| ||||||||||
relationshipsEntityRelationshipsResult | Edges extending from this entity Arguments
| ||||||||||
lineageEntityLineageResult | Edges extending from this entity grouped by direction in the lineage graph Arguments
| ||||||||||
browsePaths[BrowsePath!] | The browse paths corresponding to the dataset. If no Browse Paths have been generated before, this will be null. | ||||||||||
browsePathV2BrowsePathV2 | The browse path V2 corresponding to an entity. If no Browse Paths V2 have been generated before, this will be null. | ||||||||||
health[Health!] | Experimental! The resolved health statuses of the Dataset | ||||||||||
schemaSchema | Deprecated: Use `schemaMetadata` Schema metadata of the dataset | ||||||||||
externalUrlString | Deprecated: No longer supported Deprecated, use properties field instead External URL associated with the Dataset | ||||||||||
originFabricType! | Deprecated: No longer supported Deprecated, see the properties field instead Environment in which the dataset belongs to or where it was generated Note that this field will soon be deprecated in favor of a more standardized concept of Environment | ||||||||||
descriptionString | Deprecated: No longer supported Deprecated, use the properties field instead Read only technical description for dataset | ||||||||||
platformNativeTypePlatformNativeType | Deprecated: No longer supported Deprecated, do not use this field The logical type of the dataset ie table, stream, etc | ||||||||||
uriString | Deprecated: No longer supported Deprecated, use properties instead Native Dataset Uri Uri should not include any environment specific properties | ||||||||||
globalTagsGlobalTags | Deprecated: No longer supported Deprecated, use tags field instead The structured tags associated with the dataset | ||||||||||
subTypesSubTypes | Sub Types that this entity implements | ||||||||||
viewPropertiesViewProperties | View related properties. Only relevant if subtypes field contains view. | ||||||||||
aspects[RawAspect!] | Experimental API. For fetching extra entities that do not have custom UI code yet Arguments
| ||||||||||
runsDataProcessInstanceResult | History of datajob runs that either produced or consumed this dataset Arguments
| ||||||||||
siblingsSiblingProperties | Metadata about the datasets siblings | ||||||||||
fineGrainedLineages[FineGrainedLineage!] | Lineage information for the column-level. Includes a list of objects detailing which columns are upstream and which are downstream of each other. The upstream and downstream columns are from datasets. | ||||||||||
privilegesEntityPrivileges | Privileges given to a user relevant to this entity | ||||||||||
existsBoolean | Whether or not this entity exists on DataHub | ||||||||||
structuredPropertiesStructuredProperties | Structured properties about this Dataset | ||||||||||
incidentsEntityIncidentsResult | Incidents associated with the Dataset Arguments
| ||||||||||
testResultsTestResults | The results of evaluating tests |
DatasetAssertionInfo
Detailed information about a Dataset Assertion
Fields
Name | Description |
---|---|
datasetUrnString! | The urn of the dataset that the assertion is related to |
scopeDatasetAssertionScope! | The scope of the Dataset assertion. |
fields[SchemaFieldRef!] | The fields serving as input to the assertion. Empty if there are none. |
aggregationAssertionStdAggregation | Standardized assertion operator |
operatorAssertionStdOperator! | Standardized assertion operator |
parametersAssertionStdParameters | Standard parameters required for the assertion. e.g. min_value, max_value, value, columns |
nativeTypeString | The native operator for the assertion. For Great Expectations, this will contain the original expectation name. |
nativeParameters[StringMapEntry!] | Native parameters required for the assertion. |
logicString | Logic comprising a raw, unstructured assertion. |
DatasetDeprecation
Deprecated, use Deprecation instead Information about Dataset deprecation status Note that this model will soon be migrated to a more general purpose Entity status
Fields
Name | Description |
---|---|
deprecatedBoolean! | Whether the dataset has been deprecated by owner |
decommissionTimeLong | The time user plan to decommission this dataset |
noteString! | Additional information about the dataset deprecation plan |
actorString | The user who will be credited for modifying this deprecation content |
DatasetEditableProperties
Dataset properties that are editable via the UI This represents logical metadata, as opposed to technical metadata
Fields
Name | Description |
---|---|
descriptionString | Description of the Dataset |
nameString | Editable name of the Dataset |
DatasetFieldProfile
An individual Dataset Field Profile
Fields
Name | Description |
---|---|
fieldPathString! | The standardized path of the field |
uniqueCountLong | The unique value count for the field across the Dataset |
uniqueProportionFloat | The proportion of rows with unique values across the Dataset |
nullCountLong | The number of NULL row values across the Dataset |
nullProportionFloat | The proportion of rows with NULL values across the Dataset |
minString | The min value for the field |
maxString | The max value for the field |
meanString | The mean value for the field |
medianString | The median value for the field |
stdevString | The standard deviation for the field |
sampleValues[String!] | A set of sample values for the field |
DatasetFilter
Describes a generic filter on a dataset
Fields
Name | Description |
---|---|
typeDatasetFilterType! | Type of partition |
sqlString | The raw query if using a SQL FilterType |
DatasetProfile
A Dataset Profile associated with a Dataset, containing profiling statistics about the Dataset
Implements
Fields
Name | Description |
---|---|
timestampMillisLong! | The time at which the profile was reported |
rowCountLong | An optional row count of the Dataset |
columnCountLong | An optional column count of the Dataset |
sizeInBytesLong | The storage size in bytes |
fieldProfiles[DatasetFieldProfile!] | An optional set of per field statistics obtained in the profile |
partitionSpecPartitionSpec | Information about the partition that was profiled |
DatasetProperties
Additional read only properties about a Dataset
Fields
Name | Description |
---|---|
nameString! | The name of the dataset used in display |
qualifiedNameString | Fully-qualified name of the Dataset |
originFabricType! | Environment in which the dataset belongs to or where it was generated Note that this field will soon be deprecated in favor of a more standardized concept of Environment |
descriptionString | Read only technical description for dataset |
customProperties[CustomPropertiesEntry!] | Custom properties of the Dataset |
externalUrlString | External URL associated with the Dataset |
createdLong | Created timestamp millis associated with the Dataset |
createdActorString | Actor associated with the Dataset's created timestamp |
lastModifiedAuditStamp! | Last Modified timestamp millis associated with the Dataset |
lastModifiedActorString | Deprecated: No longer supported Actor associated with the Dataset's lastModified timestamp. Deprecated - Use lastModified.actor instead. |
DatasetStatsSummary
Experimental - subject to change. A summary of usage metrics about a Dataset.
Fields
Name | Description |
---|---|
queryCountLast30DaysInt | The query count in the past 30 days |
uniqueUserCountLast30DaysInt | The unique user count in the past 30 days |
topUsersLast30Days[CorpUser!] | The top users in the past 30 days |
DataTypeEntity
A data type registered in DataHub
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | A primary key associated with the Query | ||||
typeEntityType! | A standard Entity Type | ||||
infoDataTypeInfo! | Info about this type including its name | ||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from this entity Arguments
|
DataTypeInfo
Properties about an individual data type
Fields
Name | Description |
---|---|
typeStdDataType! | The standard data type |
qualifiedNameString! | The fully qualified name of the type. This includes its namespace |
displayNameString | The display name of this type |
descriptionString | The description of this type |
DateRange
For consumption by UI only
Fields
Name | Description |
---|---|
startString! | |
endString! |
DebugAccessResult
Experimental API result to debug Access for users. Backward incompatible changes will be made without notice in the future.
Fields
Name | Description |
---|---|
roles[String!]! | Roles that the user has. |
groups[String!]! | Groups that the user belongs to. |
groupsWithRoles[String!]! | List of groups that the user is assigned to AND where the group has a role. This is a subset of the groups property. |
rolesViaGroups[String!]! | Final set of roles that are coming through groups. If not role assigned to groups, then this would be empty. |
allRoles[String!]! | Union of |
policies[String!]! | List of Policy that apply to this user directly or indirectly. |
privileges[String!]! | List of privileges that this user has directly or indirectly. |
Deprecation
Information about Metadata Entity deprecation status
Fields
Name | Description |
---|---|
deprecatedBoolean! | Whether the entity has been deprecated by owner |
decommissionTimeLong | The time user plan to decommission this entity |
noteString | Additional information about the entity deprecation plan |
actorString | The user who will be credited for modifying this deprecation content |
actorEntityEntity | The hydrated user who will be credited for modifying this deprecation content |
DocPropagationSettings
Global (platform-level) settings related to the doc propagation feature
Fields
Name | Description |
---|---|
docColumnPropagationBoolean | The default doc propagation setting for the platform. |
Documentation
Object containing the documentation aspect for an entity
Fields
Name | Description |
---|---|
documentations[DocumentationAssociation!]! | Structured properties on this entity |
DocumentationAssociation
Object containing the documentation aspect for an entity
Fields
Name | Description |
---|---|
documentationString! | Structured properties on this entity |
attributionMetadataAttribution | Information about who, why, and how this metadata was applied |
Domain
A domain, or a logical grouping of Metadata Entities
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the domain | ||||
typeEntityType! | A standard Entity Type | ||||
idString! | Id of the domain | ||||
propertiesDomainProperties | Properties about a domain | ||||
ownershipOwnership | Ownership metadata of the dataset | ||||
institutionalMemoryInstitutionalMemory | References to internal resources related to the dataset | ||||
entitiesSearchResults | Children entities inside of the Domain Arguments
| ||||
parentDomainsParentDomainsResult | Recursively get the lineage of parent domains for this entity | ||||
relationshipsEntityRelationshipsResult | Edges extending from this entity Arguments
| ||||
aspects[RawAspect!] | Experimental API. For fetching extra entities that do not have custom UI code yet Arguments
| ||||
structuredPropertiesStructuredProperties | Structured properties about this asset | ||||
formsForms | The forms associated with the Dataset | ||||
privilegesEntityPrivileges | Privileges given to a user relevant to this entity |
DomainAssociation
Fields
Name | Description |
---|---|
domainDomain! | The domain related to the assocaited urn |
associatedUrnString! | Reference back to the tagged urn for tracking purposes e.g. when sibling nodes are merged together |
DomainProperties
Properties about a domain
Fields
Name | Description |
---|---|
nameString! | Display name of the domain |
descriptionString | Description of the Domain |
DownstreamEntityRelationships
Deprecated, use relationships query instead
Fields
Name | Description |
---|---|
entities[EntityRelationshipLegacy] |
EditableSchemaFieldInfo
Editable schema field metadata ie descriptions, tags, etc
Fields
Name | Description |
---|---|
fieldPathString! | Flattened name of a field identifying the field the editable info is applied to |
descriptionString | Edited description of the field |
globalTagsGlobalTags | Deprecated: No longer supported Deprecated, use tags field instead Tags associated with the field |
tagsGlobalTags | Tags associated with the field |
glossaryTermsGlossaryTerms | Glossary terms associated with the field |
EditableSchemaMetadata
Information about schema metadata that is editable via the UI
Fields
Name | Description |
---|---|
editableSchemaFieldInfo[EditableSchemaFieldInfo!]! | Editable schema field metadata |
EditableTagProperties
Additional read write Tag properties Deprecated! Replaced by TagProperties.
Fields
Name | Description |
---|---|
nameString | A display name for the Tag |
descriptionString | A description of the Tag |
Embed
Information required to render an embedded version of an asset
Fields
Name | Description |
---|---|
renderUrlString | A URL which can be rendered inside of an iframe. |
EntityAssertionsResult
A list of Assertions Associated with an Entity
Fields
Name | Description |
---|---|
startInt! | The starting offset of the result set returned |
countInt! | The number of assertions in the returned result set |
totalInt! | The total number of assertions in the result set |
assertions[Assertion!]! | The assertions themselves |
EntityCountResult
Fields
Name | Description |
---|---|
entityTypeEntityType! | |
countInt! |
EntityCountResults
Fields
Name | Description |
---|---|
counts[EntityCountResult!] |
EntityIncidentsResult
A list of Incidents Associated with an Entity
Fields
Name | Description |
---|---|
startInt! | The starting offset of the result set returned |
countInt! | The number of assertions in the returned result set |
totalInt! | The total number of assertions in the result set |
incidents[Incident!]! | The incidents themselves |
EntityLineageResult
A list of lineage information associated with a source Entity
Fields
Name | Description |
---|---|
startInt | Start offset of the result set |
countInt | Number of results in the returned result set |
totalInt | Total number of results in the result set |
filteredInt | The number of results that were filtered out of the page (soft-deleted or non-existent) |
relationships[LineageRelationship!]! | Relationships in the result set |
EntityPath
An overview of the field that was matched in the entity search document
Fields
Name | Description |
---|---|
path[Entity] | Path of entities between source and destination nodes |
EntityPrivileges
Shared privileges object across entities. Not all privileges apply to every entity.
Fields
Name | Description |
---|---|
canManageChildrenBoolean | Whether or not a user can create child entities under a parent entity. For example, can one create Terms/Node sunder a Glossary Node. |
canManageEntityBoolean | Whether or not a user can delete or move this entity. |
canEditLineageBoolean | Whether or not a user can create or delete lineage edges for an entity. |
canEditEmbedBoolean | Whether or not a user update the embed information |
canEditQueriesBoolean | Whether or not a user can update the Queries for the entity (e.g. dataset) |
canEditPropertiesBoolean | Whether or not a user can update the properties for the entity (e.g. dataset) |
canEditIncidentsBoolean | Whether or not a user can update incidents for the entity |
EntityProfileConfig
Configuration for an entity profile
Fields
Name | Description |
---|---|
defaultTabString | The enum value from EntityProfileTab for which tab should be showed by default on entity profile pages. If null, rely on default sorting from React code. |
EntityProfileParams
Context to define the entity profile page
Fields
Name | Description |
---|---|
urnString! | Urn of the entity being shown |
typeEntityType! | Type of the enity being displayed |
EntityProfilesConfig
Configuration for different entity profiles
Fields
Name | Description |
---|---|
domainEntityProfileConfig | The configurations for a Domain entity profile |
EntityRelationship
A relationship between two entities TODO Migrate all entity relationships to this more generic model
Fields
Name | Description |
---|---|
typeString! | The type of the relationship |
directionRelationshipDirection! | The direction of the relationship relative to the source entity |
entityEntity | Entity that is related via lineage |
createdAuditStamp | An AuditStamp corresponding to the last modification of this relationship |
EntityRelationshipLegacy
Deprecated, use relationships query instead
Fields
Name | Description |
---|---|
entityEntityWithRelationships | Entity that is related via lineage |
createdAuditStamp | An AuditStamp corresponding to the last modification of this relationship |
EntityRelationshipsResult
A list of relationship information associated with a source Entity
Fields
Name | Description |
---|---|
startInt | Start offset of the result set |
countInt | Number of results in the returned result set |
totalInt | Total number of results in the result set |
relationships[EntityRelationship!]! | Relationships in the result set |
EntityTypeEntity
An entity type registered in DataHub
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | A primary key associated with the Query | ||||
typeEntityType! | A standard Entity Type | ||||
infoEntityTypeInfo! | Info about this type including its name | ||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from this entity Arguments
|
EntityTypeInfo
Properties about an individual entity type
Fields
Name | Description |
---|---|
typeEntityType! | The standard entity type |
qualifiedNameString! | The fully qualified name of the entity type. This includes its namespace |
displayNameString | The display name of this type |
descriptionString | The description of this type |
ERModelRelationship
An ERModelRelationship is a high-level abstraction that dictates what datasets fields are erModelRelationshiped.
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the role | ||||
typeEntityType! | The standard Entity Type | ||||
idString! | Unique id for the erModelRelationship | ||||
propertiesERModelRelationshipProperties | An additional set of read only properties | ||||
editablePropertiesERModelRelationshipEditableProperties | An additional set of of read write properties | ||||
institutionalMemoryInstitutionalMemory | References to internal resources related to the dataset | ||||
ownershipOwnership | Ownership metadata of the dataset | ||||
statusStatus | Status of the Dataset | ||||
tagsGlobalTags | Tags used for searching dataset | ||||
glossaryTermsGlossaryTerms | The structured glossary terms associated with the dataset | ||||
relationshipsEntityRelationshipsResult | List of relationships between the source Entity and some destination entities with a given types Arguments
| ||||
privilegesEntityPrivileges | Privileges given to a user relevant to this entity | ||||
lineageEntityLineageResult | No-op required for the model Arguments
|
ERModelRelationshipEditableProperties
Additional properties about a ERModelRelationship
Fields
Name | Description |
---|---|
descriptionString | Documentation of the ERModelRelationship |
nameString | Display name of the ERModelRelationship |
ERModelRelationshipProperties
Additional properties about a ERModelRelationship
Fields
Name | Description |
---|---|
nameString! | The name of the ERModelRelationship used in display |
sourceDataset! | The urn of source |
destinationDataset! | The urn of destination |
relationshipFieldMappings[RelationshipFieldMapping!] | The relationFieldMappings |
createdTimeLong | Created timestamp millis associated with the ERModelRelationship |
createdActorEntity | Created actor urn associated with the ERModelRelationship |
EthicalConsiderations
Fields
Name | Description |
---|---|
data[String!] | Does the model use any sensitive data eg, protected classes |
humanLife[String!] | Is the model intended to inform decisions about matters central to human life or flourishing eg, health or safety |
mitigations[String!] | What risk mitigation strategies were used during model development |
risksAndHarms[String!] | What risks may be present in model usage Try to identify the potential recipients, likelihood, and magnitude of harms If these cannot be determined, note that they were considered but remain unknown |
useCases[String!] | Are there any known model use cases that are especially fraught This may connect directly to the intended use section |
ExecutionRequest
Retrieve an ingestion execution request
Fields
Name | Description |
---|---|
urnString! | Urn of the execution request |
idString! | Unique id for the execution request |
inputExecutionRequestInput! | Input provided when creating the Execution Request |
resultExecutionRequestResult | Result of the execution request |
ExecutionRequestInput
Input provided when creating an Execution Request
Fields
Name | Description |
---|---|
taskString! | The type of the task to executed |
sourceExecutionRequestSource! | The source of the execution request |
arguments[StringMapEntry!] | Arguments provided when creating the execution request |
requestedAtLong! | The time at which the request was created |
actorUrnString | Urn of the actor who created this execution request |
ExecutionRequestResult
The result of an ExecutionRequest
Fields
Name | Description |
---|---|
statusString! | The result of the request, e.g. either SUCCEEDED or FAILED |
startTimeMsLong | Time at which the task began |
durationMsLong | Duration of the task |
reportString | A report about the ingestion run |
structuredReportStructuredReport | A structured report for this Execution Request |
ExecutionRequestSource
Information about the source of an execution request
Fields
Name | Description |
---|---|
typeString | The type of the source, e.g. SCHEDULED_INGESTION_SOURCE |
ExtraProperty
Fields
Name | Description |
---|---|
nameString! | Name of the extra property |
valueString! | Value of the extra property |
FacetFilter
A single filter value
Fields
Name | Description |
---|---|
fieldString! | Name of field to filter by |
conditionFilterOperator | Condition for the values. |
values[String!]! | Values, one of which the intended field should match. |
negatedBoolean | If the filter should or should not be matched |
FacetMetadata
Contains valid fields to filter search results further on
Fields
Name | Description |
---|---|
fieldString! | Name of a field present in the search entity |
displayNameString | Display name of the field |
aggregations[AggregationMetadata!]! | Aggregated search result counts by value of the field |
FeatureFlagsConfig
Configurations related to DataHub Views feature
Fields
Name | Description |
---|---|
readOnlyModeEnabledBoolean! | Whether read only mode is enabled on an instance. Right now this only affects ability to edit user profile image URL but can be extended. |
showSearchFiltersV2Boolean! | Whether search filters V2 should be shown or the default filter side-panel |
showBrowseV2Boolean! | Whether browse V2 sidebar should be shown |
platformBrowseV2Boolean! | Whether browse v2 is platform mode, which means that platforms are displayed instead of entity types at the root. |
showAcrylInfoBoolean! | Whether we should show CTAs in the UI related to moving to DataHub Cloud by Acryl. |
erModelRelationshipFeatureEnabledBoolean! | Whether ERModelRelationship Tables Feature should be shown. |
showAccessManagementBoolean! | Whether we should show AccessManagement tab in the datahub UI. |
nestedDomainsEnabledBoolean! | Enables the nested Domains feature that allows users to have sub-Domains. If this is off, Domains appear "flat" again. |
businessAttributeEntityEnabledBoolean! | Whether business attribute entity should be shown |
dataContractsEnabledBoolean! | Whether data contracts should be enabled |
editableDatasetNameEnabledBoolean! | Whether dataset names are editable |
showSeparateSiblingsBoolean! | If turned on, all siblings will be separated with no way to get to a "combined" sibling view |
FieldAssertionInfo
A definition of a Field (Column) assertion.
Fields
Name | Description |
---|---|
typeFieldAssertionType! | The type of the field assertion being monitored. |
entityUrnString! | The entity targeted by this Field check. |
fieldValuesAssertionFieldValuesAssertion | The definition of an assertion that validates individual values of a field / column for a set of rows. |
fieldMetricAssertionFieldMetricAssertion | The definition of an assertion that validates a common metric obtained about a field / column for a set of rows. |
filterDatasetFilter | A definition of the specific filters that should be applied, when performing monitoring. If not provided, there is no filter, and the full table is under consideration. |
FieldFormPromptAssociation
An association for field-level form prompts
Fields
Name | Description |
---|---|
fieldPathString! | The schema field path |
lastModifiedResolvedAuditStamp! | When and by whom this form field-level prompt has last been modified |
FieldMetricAssertion
A definition of a Field Metric assertion.
Fields
Name | Description |
---|---|
fieldSchemaFieldSpec! | The field under evaluation |
metricFieldMetricType! | The specific metric to assert against. |
operatorAssertionStdOperator! | The predicate to evaluate against the metric for the field / column. |
parametersAssertionStdParameters | Standard parameters required for the assertion. |
FieldTransform
Definition of a transform applied to the values of a column / field.
Fields
Name | Description |
---|---|
typeFieldTransformType! | The type of the field transform. |
FieldUsageCounts
The usage for a particular Dataset field
Fields
Name | Description |
---|---|
fieldNameString | The path of the field |
countInt | The count of usages |
FieldValuesAssertion
A definition of a Field Values assertion.
Fields
Name | Description |
---|---|
fieldSchemaFieldSpec! | The field under evaluation. |
transformFieldTransform | An optional transform to apply to field values before evaluating the operator. |
operatorAssertionStdOperator! | The predicate to evaluate against a single value of the field. Depending on the operator, parameters may be required |
parametersAssertionStdParameters | Standard parameters required for the assertion. |
failThresholdFieldValuesFailThreshold! | Additional customization about when the assertion should be officially considered failing. |
excludeNullsBoolean! | Whether to ignore or allow nulls when running the values assertion. |
FieldValuesFailThreshold
Fields
Name | Description |
---|---|
typeFieldValuesFailThresholdType! | The type of failure threshold. |
valueLong! | The value of the threshold, either representing a count or percentage. |
FineGrainedLineage
Fields
Name | Description |
---|---|
upstreams[SchemaFieldRef!] | |
downstreams[SchemaFieldRef!] | |
queryString | |
transformOperationString |
FixedIntervalSchedule
A fixed interval schedule.
Fields
Name | Description |
---|---|
unitDateInterval! | Interval unit such as minute/hour/day etc. |
multipleInt! | How many units. Defaults to 1. |
FloatBox
Fields
Name | Description |
---|---|
floatValueFloat! |
ForeignKeyConstraint
Metadata around a foreign key constraint between two datasets
Fields
Name | Description |
---|---|
nameString | The human-readable name of the constraint |
foreignFields[SchemaFieldEntity] | List of fields in the foreign dataset |
sourceFields[SchemaFieldEntity] | List of fields in this dataset |
foreignDatasetDataset | The foreign dataset for easy reference |
Form
A form that helps with filling out metadata on an entity
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | A primary key associated with the Form | ||||
typeEntityType! | A standard Entity Type | ||||
infoFormInfo! | Information about this form | ||||
ownershipOwnership | Ownership metadata of the form | ||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from this entity Arguments
|
FormActorAssignment
Fields
Name | Description |
---|---|
ownersBoolean! | Whether the form should be completed by owners of the assets which the form is applied to. |
users[CorpUser!] | Urns of the users that the form is assigned to. If null, then no users are specifically targeted. |
groups[CorpGroup!] | Groups that the form is assigned to. If null, then no groups are specifically targeted. |
isAssignedToMeBoolean! | Whether or not the current actor is universally assigned to this form, either by user or by group. Note that this does not take into account entity ownership based assignment. |
FormAssociation
Fields
Name | Description |
---|---|
formForm! | The form related to the associated urn |
associatedUrnString! | Reference back to the urn with the form on it for tracking purposes e.g. when sibling nodes are merged together |
incompletePrompts[FormPromptAssociation!] | The prompt that still need to be completed for this form |
completedPrompts[FormPromptAssociation!] | The prompt that are already completed for this form |
FormInfo
Properties about an individual Form
Fields
Name | Description |
---|---|
nameString! | The name of this form |
descriptionString | The description of this form |
typeFormType! | The type of this form |
prompts[FormPrompt!]! | The prompt for this form |
actorsFormActorAssignment! | The actors that are assigned to complete the forms for the associated entities. |
FormPrompt
A prompt shown to the user to collect metadata about an entity
Fields
Name | Description |
---|---|
idString! | The ID of this prompt. This will be globally unique. |
titleString! | The title of this prompt |
formUrnString! | The urn of the parent form that this prompt is part of |
descriptionString | The description of this prompt |
typeFormPromptType! | The description of this prompt |
requiredBoolean! | Whether the prompt is required for the form to be considered completed. |
structuredPropertyParamsStructuredPropertyParams | The params for this prompt if type is STRUCTURED_PROPERTY |
FormPromptAssociation
A form that helps with filling out metadata on an entity
Fields
Name | Description |
---|---|
idString! | The unique id of the form prompt |
lastModifiedResolvedAuditStamp! | When and by whom this form prompt has last been modified |
fieldAssociationsFormPromptFieldAssociations | Optional information about the field-level prompt associations. |
FormPromptFieldAssociations
Information about the field-level prompt associations.
Fields
Name | Description |
---|---|
completedFieldPrompts[FieldFormPromptAssociation!] | If this form prompt is for fields, this will contain a list of completed associations per field |
incompleteFieldPrompts[FieldFormPromptAssociation!] | If this form prompt is for fields, this will contain a list of incomlete associations per field |
Forms
Requirements forms that are assigned to an entity.
Fields
Name | Description |
---|---|
incompleteForms[FormAssociation!]! | Forms that are still incomplete. |
completedForms[FormAssociation!]! | Forms that have been completed. |
verifications[FormVerificationAssociation!]! | Verifications that have been applied to the entity via completed forms. |
FormVerificationAssociation
Verification object that has been applied to the entity via a completed form.
Fields
Name | Description |
---|---|
formForm! | The form related to the associated urn |
lastModifiedResolvedAuditStamp | When this verification was applied to this entity |
FreshnessAssertionInfo
Information about an Freshness assertion.
Fields
Name | Description |
---|---|
entityUrnString! | The urn of the entity that the Freshness assertion is related to |
typeFreshnessAssertionType! | The type of the Freshness Assertion |
scheduleFreshnessAssertionSchedule! | Produce FAIL Assertion Result if the asset is not updated on the cadence and within the time range described by the schedule. |
filterDatasetFilter | A filter applied when querying an external Dataset or Table |
FreshnessAssertionSchedule
Attributes defining a single Freshness schedule.
Fields
Name | Description |
---|---|
typeFreshnessAssertionScheduleType! | The type of schedule |
cronFreshnessCronSchedule | A cron schedule. This is populated if the type is CRON. |
fixedIntervalFixedIntervalSchedule | A fixed interval schedule. This is populated if the type is FIXED_INTERVAL. |
FreshnessContract
Fields
Name | Description |
---|---|
assertionAssertion! | The assertion representing the Freshness contract. |
FreshnessCronSchedule
A cron-formatted schedule
Fields
Name | Description |
---|---|
cronString! | A cron-formatted execution interval, as a cron string, e.g. 1 * * * * |
timezoneString! | Timezone in which the cron interval applies, e.g. America/Los Angeles |
windowStartOffsetMsLong | An optional offset in milliseconds to SUBTRACT from the timestamp generated by the cron schedule to generate the lower bounds of the "Freshness window", or the window of time in which an event must have occurred in order for the Freshness to be considering passing. If left empty, the start of the Freshness window will be the end of the previously evaluated Freshness window. |
FreshnessStats
Freshness stats for a query result. Captures whether the query was served out of a cache, what the staleness was, etc.
Fields
Name | Description |
---|---|
cachedBoolean | Whether a cache was used to respond to this query |
systemFreshness[SystemFreshness] | The latest timestamp in millis of the system that was used to respond to this query In case a cache was consulted, this reflects the freshness of the cache In case an index was consulted, this reflects the freshness of the index |
GetQuickFiltersResult
The result object when fetching quick filters
Fields
Name | Description |
---|---|
quickFilters[QuickFilter]! | The list of quick filters to render in the UI |
GetRootGlossaryNodesResult
The result when getting Glossary entities
Fields
Name | Description |
---|---|
nodes[GlossaryNode!]! | A list of Glossary Nodes without a parent node |
startInt! | The starting offset of the result set returned |
countInt! | The number of nodes in the returned result |
totalInt! | The total number of nodes in the result set |
GetRootGlossaryTermsResult
The result when getting root GlossaryTerms
Fields
Name | Description |
---|---|
terms[GlossaryTerm!]! | A list of Glossary Terms without a parent node |
startInt! | The starting offset of the result set returned |
countInt! | The number of terms in the returned result |
totalInt! | The total number of terms in the result set |
GetSchemaBlameResult
Schema changes computed at a specific version.
Fields
Name | Description |
---|---|
versionSemanticVersionStruct | Selected semantic version |
schemaFieldBlameList[SchemaFieldBlame!] | List of schema blame. Absent when there are no fields to return history for. |
GetSchemaVersionListResult
Schema changes computed at a specific version.
Fields
Name | Description |
---|---|
latestVersionSemanticVersionStruct | Latest and current semantic version |
versionSemanticVersionStruct | Selected semantic version |
semanticVersionList[SemanticVersionStruct!] | All semantic versions. Absent when there are no versions. |
GlobalTags
Tags attached to a particular Metadata Entity
Fields
Name | Description |
---|---|
tags[TagAssociation!] | The set of tags attached to the Metadata Entity |
GlobalViewsSettings
Global (platform-level) settings related to the Views feature
Fields
Name | Description |
---|---|
defaultViewString | The global default View. If a user does not have a personal default, then this will be the default view. |
GlossaryNode
A Glossary Node, or a directory in a Business Glossary represents a container of Glossary Terms or other Glossary Nodes
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the glossary term | ||||
ownershipOwnership | Ownership metadata of the glossary term | ||||
typeEntityType! | A standard Entity Type | ||||
propertiesGlossaryNodeProperties | Additional properties associated with the Glossary Term | ||||
relationshipsEntityRelationshipsResult | Edges extending from this entity Arguments
| ||||
parentNodesParentNodesResult | Recursively get the lineage of glossary nodes for this entity | ||||
privilegesEntityPrivileges | Privileges given to a user relevant to this entity | ||||
existsBoolean | Whether or not this entity exists on DataHub | ||||
aspects[RawAspect!] | Experimental API. For fetching extra entities that do not have custom UI code yet Arguments
| ||||
structuredPropertiesStructuredProperties | Structured properties about this asset | ||||
formsForms | The forms associated with the Dataset |
GlossaryNodeProperties
Additional read only properties about a Glossary Node
Fields
Name | Description |
---|---|
nameString! | The name of the Glossary Term |
descriptionString | Description of the glossary term |
customProperties[CustomPropertiesEntry!] | Custom properties of the Glossary Node |
GlossaryTerm
A Glossary Term, or a node in a Business Glossary representing a standardized domain data type
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the glossary term | ||||
ownershipOwnership | Ownership metadata of the glossary term | ||||
domainDomainAssociation | The Domain associated with the glossary term | ||||
institutionalMemoryInstitutionalMemory | References to internal resources related to the Glossary Term | ||||
typeEntityType! | A standard Entity Type | ||||
nameString! | Deprecated: No longer supported A unique identifier for the Glossary Term. Deprecated - Use properties.name field instead. | ||||
hierarchicalNameString! | hierarchicalName of glossary term | ||||
propertiesGlossaryTermProperties | Additional properties associated with the Glossary Term | ||||
glossaryTermInfoGlossaryTermInfo | Deprecated, use properties field instead Details of the Glossary Term | ||||
deprecationDeprecation | The deprecation status of the Glossary Term | ||||
relationshipsEntityRelationshipsResult | Edges extending from this entity Arguments
| ||||
schemaMetadataSchemaMetadata | Schema metadata of the dataset Arguments
| ||||
parentNodesParentNodesResult | Recursively get the lineage of glossary nodes for this entity | ||||
privilegesEntityPrivileges | Privileges given to a user relevant to this entity | ||||
existsBoolean | Whether or not this entity exists on DataHub | ||||
aspects[RawAspect!] | Experimental API. For fetching extra entities that do not have custom UI code yet Arguments
| ||||
structuredPropertiesStructuredProperties | Structured properties about this asset | ||||
formsForms | The forms associated with the Dataset |
GlossaryTermAssociation
An edge between a Metadata Entity and a Glossary Term Modeled as a struct to permit additional attributes TODO Consider whether this query should be serviced by the relationships field
Fields
Name | Description |
---|---|
termGlossaryTerm! | The glossary term itself |
actorCorpUser | The actor who is responsible for the term being added" |
associatedUrnString! | Reference back to the associated urn for tracking purposes e.g. when sibling nodes are merged together |
GlossaryTermInfo
Deprecated, use GlossaryTermProperties instead Information about a glossary term
Fields
Name | Description |
---|---|
nameString | The name of the Glossary Term |
descriptionString | Description of the glossary term |
definitionString! | Deprecated: No longer supported Definition of the glossary term. Deprecated - Use 'description' instead. |
termSourceString! | Term Source of the glossary term |
sourceRefString | Source Ref of the glossary term |
sourceUrlString | Source Url of the glossary term |
customProperties[CustomPropertiesEntry!] | Properties of the glossary term |
rawSchemaString | Schema definition of glossary term |
GlossaryTermProperties
Additional read only properties about a Glossary Term
Fields
Name | Description |
---|---|
nameString! | The name of the Glossary Term |
descriptionString | Description of the glossary term |
definitionString! | Deprecated: No longer supported Definition of the glossary term. Deprecated - Use 'description' instead. |
termSourceString! | Term Source of the glossary term |
sourceRefString | Source Ref of the glossary term |
sourceUrlString | Source Url of the glossary term |
customProperties[CustomPropertiesEntry!] | Properties of the glossary term |
rawSchemaString | Schema definition of glossary term |
GlossaryTerms
Glossary Terms attached to a particular Metadata Entity
Fields
Name | Description |
---|---|
terms[GlossaryTermAssociation!] | The set of glossary terms attached to the Metadata Entity |
Health
The resolved Health of an Asset
Fields
Name | Description |
---|---|
typeHealthStatusType! | An enum representing the type of health indicator |
statusHealthStatus! | An enum representing the resolved Health status of an Asset |
messageString | An optional message describing the resolved health status |
causes[String!] | The causes responsible for the health status |
Highlight
For consumption by UI only
Fields
Name | Description |
---|---|
valueInt! | |
titleString! | |
bodyString! |
HyperParameterMap
Fields
Name | Description |
---|---|
keyString! | |
valueHyperParameterValueType! |
IdentityManagementConfig
Configurations related to Identity Management
Fields
Name | Description |
---|---|
enabledBoolean! | Whether identity management screen is able to be shown in the UI |
Incident
An incident represents an active issue on a data asset.
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the Incident | ||||
typeEntityType! | The standard Entity Type | ||||
incidentTypeIncidentType! | The type of incident | ||||
customTypeString | A custom type of incident. Present only if type is 'CUSTOM' | ||||
titleString | An optional title associated with the incident | ||||
descriptionString | An optional description associated with the incident | ||||
statusIncidentStatus! | The status of an incident | ||||
priorityInt | Optional priority of the incident. Lower value indicates higher priority. | ||||
entityEntity! | The entity that the incident is associated with. | ||||
sourceIncidentSource | The source of the incident, i.e. how it was generated | ||||
createdAuditStamp! | The time at which the incident was initially created | ||||
tagsGlobalTags | The standard tags for the Incident | ||||
relationshipsEntityRelationshipsResult | List of relationships between the source Entity and some destination entities with a given types Arguments
|
IncidentSource
Details about the source of an incident, e.g. how it was created.
Fields
Name | Description |
---|---|
typeIncidentSourceType! | The type of the incident source |
sourceEntity | The source of the incident. If the source type is ASSERTION_FAILURE, this will have the assertion that generated the incident. |
IncidentStatus
Details about the status of an asset incident
Fields
Name | Description |
---|---|
stateIncidentState! | The state of the incident |
messageString | An optional message associated with the status |
lastUpdatedAuditStamp! | The time that the status last changed |
IncrementingSegmentFieldTransformer
The definition of the transformer function that should be applied to a given field / column value in a dataset in order to determine the segment or bucket that it belongs to, which in turn is used to evaluate volume assertions.
Fields
Name | Description |
---|---|
typeIncrementingSegmentFieldTransformerType! | The 'standard' operator type. Note that not all source systems will support all operators. |
nativeTypeString | The 'native' transformer type, useful as a back door if a custom transformer is required. This field is required if the type is NATIVE. |
IncrementingSegmentRowCountChange
Attributes defining an INCREMENTING_SEGMENT_ROW_COUNT_CHANGE volume assertion.
Fields
Name | Description |
---|---|
segmentIncrementingSegmentSpec! | A specification of how the 'segment' can be derived using a column and an optional transformer function. |
typeAssertionValueChangeType! | The type of the value used to evaluate the assertion: a fixed absolute value or a relative percentage. |
operatorAssertionStdOperator! | The operator you'd like to apply to the row count value Note that only numeric operators are valid inputs: GREATER_THAN, GREATER_THAN_OR_EQUAL_TO, EQUAL_TO, LESS_THAN, LESS_THAN_OR_EQUAL_TO, BETWEEN. |
parametersAssertionStdParameters! | The parameters you'd like to provide as input to the operator. Note that only numeric parameter types are valid inputs: NUMBER. |
IncrementingSegmentRowCountTotal
Attributes defining an INCREMENTING_SEGMENT_ROW_COUNT_TOTAL volume assertion.
Fields
Name | Description |
---|---|
segmentIncrementingSegmentSpec! | A specification of how the 'segment' can be derived using a column and an optional transformer function. |
operatorAssertionStdOperator! | The operator you'd like to apply. Note that only numeric operators are valid inputs: GREATER_THAN, GREATER_THAN_OR_EQUAL_TO, EQUAL_TO, LESS_THAN, LESS_THAN_OR_EQUAL_TO, BETWEEN. |
parametersAssertionStdParameters! | The parameters you'd like to provide as input to the operator. Note that only numeric parameter types are valid inputs: NUMBER. |
IncrementingSegmentSpec
Core attributes required to identify an incrementing segment in a table. This type is mainly useful for tables that constantly increase with new rows being added on a particular cadence (e.g. fact or event tables).
An incrementing segment represents a logical chunk of data which is INSERTED into a dataset on a regular interval, along with the presence of a constantly-incrementing column value such as an event time, date partition, or last modified column.
An incrementing segment is principally identified by 2 key attributes combined:
A field or column that represents the incrementing value. New rows that are inserted will be identified using this column. Note that the value of this column may not by itself represent the "bucket" or the "segment" in which the row falls.
[Optional] An transformer function that may be applied to the selected column value in order to obtain the final "segment identifier" or "bucket identifier". Rows that have the same value after applying the transformation will be grouped into the same segment, using which the final value (e.g. row count) will be determined.
Fields
Name | Description |
---|---|
fieldSchemaFieldSpec! | The field to use to generate segments. It must be constantly incrementing as new rows are inserted. |
transformerIncrementingSegmentFieldTransformer | Optional transformer function to apply to the field in order to obtain the final segment or bucket identifier. If not provided, then no operator will be applied to the field. (identity function) |
IngestionConfig
A set of configurations for an Ingestion Source
Fields
Name | Description |
---|---|
recipeString! | The JSON-encoded recipe to use for ingestion |
executorIdString! | Advanced: The specific executor that should handle the execution request. Defaults to 'default'. |
versionString | Advanced: The version of the ingestion framework to use |
debugModeBoolean | Advanced: Whether or not to run ingestion in debug mode |
extraArgs[StringMapEntry!] | Advanced: Extra arguments for the ingestion run. |
IngestionRun
The runs associated with an Ingestion Source managed by DataHub
Fields
Name | Description |
---|---|
executionRequestUrnString | The urn of the execution request associated with the user |
IngestionSchedule
A schedule associated with an Ingestion Source
Fields
Name | Description |
---|---|
timezoneString | Time Zone abbreviation (e.g. GMT, EDT). Defaults to UTC. |
intervalString! | The cron-formatted interval to execute the ingestion source on |
IngestionSource
An Ingestion Source Entity
Fields
Name | Description | ||||||
---|---|---|---|---|---|---|---|
urnString! | The primary key of the Ingestion Source | ||||||
typeString! | The type of the source itself, e.g. mysql, bigquery, bigquery-usage. Should match the recipe. | ||||||
nameString! | The display name of the Ingestion Source | ||||||
scheduleIngestionSchedule | An optional schedule associated with the Ingestion Source | ||||||
platformDataPlatform | The data platform associated with this ingestion source | ||||||
configIngestionConfig! | An type-specific set of configurations for the ingestion source | ||||||
executionsIngestionSourceExecutionRequests | Previous requests to execute the ingestion source Arguments
|
IngestionSourceExecutionRequests
Requests for execution associated with an ingestion source
Fields
Name | Description |
---|---|
startInt | The starting offset of the result set |
countInt | The number of results to be returned |
totalInt | The total number of results in the result set |
executionRequests[ExecutionRequest!]! | The execution request objects comprising the result set |
InputField
Input field of the chart
Fields
Name | Description |
---|---|
schemaFieldUrnString | |
schemaFieldSchemaField |
InputFields
Input fields of the chart
Fields
Name | Description |
---|---|
fields[InputField] |
InstitutionalMemory
Institutional memory metadata, meaning internal links and pointers related to an Entity
Fields
Name | Description |
---|---|
elements[InstitutionalMemoryMetadata!]! | List of records that represent the institutional memory or internal documentation of an entity |
InstitutionalMemoryMetadata
An institutional memory resource about a particular Metadata Entity
Fields
Name | Description |
---|---|
urlString! | Link to a document or wiki page or another internal resource |
labelString! | Label associated with the URL |
authorCorpUser! | The author of this metadata |
createdAuditStamp! | An AuditStamp corresponding to the creation of this resource |
descriptionString! | Deprecated: No longer supported Deprecated, use label instead Description of the resource |
associatedUrnString! | Reference back to the owned urn for tracking purposes e.g. when sibling nodes are merged together |
IntBox
Fields
Name | Description |
---|---|
intValueInt! |
IntendedUse
Fields
Name | Description |
---|---|
primaryUses[String!] | Primary Use cases for the model |
primaryUsers[IntendedUserType!] | Primary Intended Users |
outOfScopeUses[String!] | Out of scope uses of the MLModel |
InviteToken
Token that allows users to sign up as a native user
Fields
Name | Description |
---|---|
inviteTokenString! | The invite token |
KeyValueSchema
Information about a raw Key Value Schema
Fields
Name | Description |
---|---|
keySchemaString! | Raw key schema |
valueSchemaString! | Raw value schema |
LineageConfig
Configurations related to Lineage
Fields
Name | Description |
---|---|
supportsImpactAnalysisBoolean! | Whether the backend support impact analysis feature |
LineageRelationship
Metadata about a lineage relationship between two entities
Fields
Name | Description |
---|---|
typeString! | The type of the relationship |
entityEntity | Entity that is related via lineage |
degreeInt! | Degree of relationship (number of hops to get to entity) |
createdOnLong | Timestamp for when this lineage relationship was created. Could be null. |
createdActorEntity | The actor who created this lineage relationship. Could be null. |
updatedOnLong | Timestamp for when this lineage relationship was last updated. Could be null. |
updatedActorEntity | The actor who last updated this lineage relationship. Could be null. |
isManualBoolean | Whether this edge is a manual edge. Could be null. |
paths[EntityPath] | The paths traversed for this relationship |
LinkParams
Parameters required to specify the page to land once clicked
Fields
Name | Description |
---|---|
searchParamsSearchParams | Context to define the search page |
entityProfileParamsEntityProfileParams | Context to define the entity profile page |
ListAccessTokenResult
Results returned when listing access tokens
Fields
Name | Description |
---|---|
startInt! | The starting offset of the result set |
countInt! | The number of results to be returned |
totalInt! | The total number of results in the result set |
tokens[AccessTokenMetadata!]! | The token metadata themselves |
ListBusinessAttributesResult
The result obtained when listing Business Attribute
Fields
Name | Description |
---|---|
startInt! | The starting offset of the result set returned |
countInt! | The number of Business Attributes in the returned result set |
totalInt! | The total number of Business Attributes in the result set |
businessAttributes[BusinessAttribute!]! | The Business Attributes |
ListDomainsResult
The result obtained when listing DataHub Domains
Fields
Name | Description |
---|---|
startInt! | The starting offset of the result set returned |
countInt! | The number of Domains in the returned result set |
totalInt! | The total number of Domains in the result set |
domains[Domain!]! | The Domains themselves |
ListGroupsResult
The result obtained when listing DataHub Groups
Fields
Name | Description |
---|---|
startInt! | The starting offset of the result set returned |
countInt! | The number of Policies in the returned result set |
totalInt! | The total number of Policies in the result set |
groups[CorpGroup!]! | The groups themselves |
ListIngestionSourcesResult
Results returned when listing ingestion sources
Fields
Name | Description |
---|---|
startInt! | The starting offset of the result set |
countInt! | The number of results to be returned |
totalInt! | The total number of results in the result set |
ingestionSources[IngestionSource!]! | The Ingestion Sources themselves |
ListOwnershipTypesResult
Results when listing custom ownership types.
Fields
Name | Description |
---|---|
startInt! | The starting offset of the result set |
countInt! | The number of results to be returned |
totalInt! | The total number of results in the result set |
ownershipTypes[OwnershipTypeEntity!]! | The Custom Ownership Types themselves |
ListPoliciesResult
The result obtained when listing DataHub Access Policies
Fields
Name | Description |
---|---|
startInt! | The starting offset of the result set returned |
countInt! | The number of Policies in the returned result set |
totalInt! | The total number of Policies in the result set |
policies[Policy!]! | The Policies themselves |
ListPostsResult
The result obtained when listing Posts
Fields
Name | Description |
---|---|
startInt! | The starting offset of the result set returned |
countInt! | The number of Roles in the returned result set |
totalInt! | The total number of Roles in the result set |
posts[Post!]! | The Posts themselves |
ListQueriesResult
Results when listing entity queries
Fields
Name | Description |
---|---|
startInt! | The starting offset of the result set |
countInt! | The number of results to be returned |
totalInt! | The total number of results in the result set |
queries[QueryEntity!]! | The Queries themselves |
ListRecommendationsResult
Results returned by the ListRecommendations query
Fields
Name | Description |
---|---|
modules[RecommendationModule!]! | List of modules to show |
ListRolesResult
The result obtained when listing DataHub Roles
Fields
Name | Description |
---|---|
startInt! | The starting offset of the result set returned |
countInt! | The number of Roles in the returned result set |
totalInt! | The total number of Roles in the result set |
roles[DataHubRole!]! | The Roles themselves |
ListSecretsResult
Input for listing DataHub Secrets
Fields
Name | Description |
---|---|
startInt | The starting offset of the result set |
countInt | The number of results to be returned |
totalInt | The total number of results in the result set |
secrets[Secret!]! | The secrets themselves |
ListTestsResult
The result obtained when listing DataHub Tests
Fields
Name | Description |
---|---|
startInt! | The starting offset of the result set returned |
countInt! | The number of Tests in the returned result set |
totalInt! | The total number of Tests in the result set |
tests[Test!]! | The Tests themselves |
ListUsersResult
The result obtained when listing DataHub Users
Fields
Name | Description |
---|---|
startInt! | The starting offset of the result set returned |
countInt! | The number of Policies in the returned result set |
totalInt! | The total number of Policies in the result set |
users[CorpUser!]! | The users themselves |
ListViewsResult
The result obtained when listing DataHub Views
Fields
Name | Description |
---|---|
startInt! | The starting offset of the result set returned |
countInt! | The number of Views in the returned result set |
totalInt! | The total number of Views in the result set |
views[DataHubView!]! | The Views themselves |
ManagedIngestionConfig
Configurations related to managed, UI based ingestion
Fields
Name | Description |
---|---|
enabledBoolean! | Whether ingestion screen is enabled in the UI |
MatchedField
An overview of the field that was matched in the entity search document
Fields
Name | Description |
---|---|
nameString! | Name of the field that matched |
valueString! | Value of the field that matched |
entityEntity | Entity if the value is an urn |
Media
Media content
Fields
Name | Description |
---|---|
typeMediaType! | The type of media |
locationString! | The location of the media (a URL) |
MetadataAttribution
Information about who, why, and how this metadata was applied
Fields
Name | Description |
---|---|
timeLong! | The time this metadata was applied |
actorEntity! | The actor responsible for this metadata application |
sourceEntity | The source of this metadata application. If propagated, this will be an action. |
sourceDetail[StringMapEntry!] | Extra details about how this metadata was applied |
Metrics
Fields
Name | Description |
---|---|
performanceMeasures[String!] | Measures of ML Model performance |
decisionThreshold[String!] | Decision Thresholds used if any |
MLFeature
An ML Feature Metadata Entity Note that this entity is incubating
Implements
Fields
Name | Description | ||||||||
---|---|---|---|---|---|---|---|---|---|
urnString! | The primary key of the ML Feature | ||||||||
typeEntityType! | A standard Entity Type | ||||||||
lastIngestedLong | The timestamp for the last time this entity was ingested | ||||||||
nameString! | The display name for the ML Feature | ||||||||
featureNamespaceString! | MLFeature featureNamespace | ||||||||
descriptionString | The description about the ML Feature | ||||||||
dataTypeMLFeatureDataType | MLFeature data type | ||||||||
ownershipOwnership | Ownership metadata of the MLFeature | ||||||||
featurePropertiesMLFeatureProperties | Deprecated: No longer supported ModelProperties metadata of the MLFeature | ||||||||
propertiesMLFeatureProperties | ModelProperties metadata of the MLFeature | ||||||||
institutionalMemoryInstitutionalMemory | References to internal resources related to the MLFeature | ||||||||
statusStatus | Status metadata of the MLFeature | ||||||||
deprecationDeprecation | Deprecation | ||||||||
browsePathV2BrowsePathV2 | The browse path V2 corresponding to an entity. If no Browse Paths V2 have been generated before, this will be null. | ||||||||
dataPlatformInstanceDataPlatformInstance | The specific instance of the data platform that this entity belongs to | ||||||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from this entity Arguments
| ||||||||
lineageEntityLineageResult | Edges extending from this entity grouped by direction in the lineage graph Arguments
| ||||||||
tagsGlobalTags | Tags applied to entity | ||||||||
glossaryTermsGlossaryTerms | The structured glossary terms associated with the entity | ||||||||
domainDomainAssociation | The Domain associated with the entity | ||||||||
editablePropertiesMLFeatureEditableProperties | An additional set of of read write properties | ||||||||
existsBoolean | Whether or not this entity exists on DataHub | ||||||||
aspects[RawAspect!] | Experimental API. For fetching extra entities that do not have custom UI code yet Arguments
| ||||||||
structuredPropertiesStructuredProperties | Structured properties about this asset | ||||||||
formsForms | The forms associated with the Dataset | ||||||||
privilegesEntityPrivileges | Privileges given to a user relevant to this entity | ||||||||
incidentsEntityIncidentsResult | Incidents associated with the ML Feature Arguments
|
MLFeatureEditableProperties
Fields
Name | Description |
---|---|
descriptionString | The edited description |
MLFeatureProperties
Fields
Name | Description |
---|---|
descriptionString | |
dataTypeMLFeatureDataType | |
versionVersionTag | |
sources[Dataset] |
MLFeatureTable
An ML Feature Table Entity Note that this entity is incubating
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the ML Feature Table | ||||
typeEntityType! | A standard Entity Type | ||||
lastIngestedLong | The timestamp for the last time this entity was ingested | ||||
nameString! | The display name | ||||
platformDataPlatform! | Standardized platform urn where the MLFeatureTable is defined | ||||
descriptionString | MLFeatureTable description | ||||
ownershipOwnership | Ownership metadata of the MLFeatureTable | ||||
propertiesMLFeatureTableProperties | Additional read only properties associated the the ML Feature Table | ||||
featureTablePropertiesMLFeatureTableProperties | Deprecated: No longer supported Deprecated, use properties field instead ModelProperties metadata of the MLFeature | ||||
institutionalMemoryInstitutionalMemory | References to internal resources related to the MLFeature | ||||
statusStatus | Status metadata of the MLFeatureTable | ||||
deprecationDeprecation | Deprecation | ||||
dataPlatformInstanceDataPlatformInstance | The specific instance of the data platform that this entity belongs to | ||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from this entity Arguments
| ||||
lineageEntityLineageResult | Edges extending from this entity grouped by direction in the lineage graph Arguments
| ||||
browsePaths[BrowsePath!] | The browse paths corresponding to the ML Feature Table. If no Browse Paths have been generated before, this will be null. | ||||
browsePathV2BrowsePathV2 | The browse path V2 corresponding to an entity. If no Browse Paths V2 have been generated before, this will be null. | ||||
tagsGlobalTags | Tags applied to entity | ||||
glossaryTermsGlossaryTerms | The structured glossary terms associated with the entity | ||||
domainDomainAssociation | The Domain associated with the entity | ||||
editablePropertiesMLFeatureTableEditableProperties | An additional set of of read write properties | ||||
existsBoolean | Whether or not this entity exists on DataHub | ||||
aspects[RawAspect!] | Experimental API. For fetching extra entities that do not have custom UI code yet Arguments
| ||||
structuredPropertiesStructuredProperties | Structured properties about this asset | ||||
formsForms | The forms associated with the Dataset | ||||
privilegesEntityPrivileges | Privileges given to a user relevant to this entity |
MLFeatureTableEditableProperties
Fields
Name | Description |
---|---|
descriptionString | The edited description |
MLFeatureTableProperties
Fields
Name | Description |
---|---|
descriptionString | |
mlFeatures[MLFeature] | |
mlPrimaryKeys[MLPrimaryKey] | |
customProperties[CustomPropertiesEntry!] |
MLHyperParam
Fields
Name | Description |
---|---|
nameString | |
descriptionString | |
valueString | |
createdAtLong |
MLMetric
Fields
Name | Description |
---|---|
nameString | |
descriptionString | |
valueString | |
createdAtLong |
MLModel
An ML Model Metadata Entity Note that this entity is incubating
Implements
Fields
Name | Description | ||||||||
---|---|---|---|---|---|---|---|---|---|
urnString! | The primary key of the ML model | ||||||||
typeEntityType! | A standard Entity Type | ||||||||
lastIngestedLong | The timestamp for the last time this entity was ingested | ||||||||
nameString! | ML model display name | ||||||||
platformDataPlatform! | Standardized platform urn where the MLModel is defined | ||||||||
originFabricType! | Fabric type where mlmodel belongs to or where it was generated | ||||||||
descriptionString | Human readable description for mlmodel | ||||||||
globalTagsGlobalTags | Deprecated: No longer supported Deprecated, use tags field instead The standard tags for the ML Model | ||||||||
tagsGlobalTags | The standard tags for the ML Model | ||||||||
ownershipOwnership | Ownership metadata of the mlmodel | ||||||||
propertiesMLModelProperties | Additional read only information about the ML Model | ||||||||
intendedUseIntendedUse | Intended use of the mlmodel | ||||||||
factorPromptsMLModelFactorPrompts | Factors metadata of the mlmodel | ||||||||
metricsMetrics | Metrics metadata of the mlmodel | ||||||||
evaluationData[BaseData!] | Evaluation Data of the mlmodel | ||||||||
trainingData[BaseData!] | Training Data of the mlmodel | ||||||||
quantitativeAnalysesQuantitativeAnalyses | Quantitative Analyses of the mlmodel | ||||||||
ethicalConsiderationsEthicalConsiderations | Ethical Considerations of the mlmodel | ||||||||
caveatsAndRecommendationsCaveatsAndRecommendations | Caveats and Recommendations of the mlmodel | ||||||||
institutionalMemoryInstitutionalMemory | References to internal resources related to the mlmodel | ||||||||
sourceCodeSourceCode | Source Code | ||||||||
statusStatus | Status metadata of the mlmodel | ||||||||
costCost | Cost Aspect of the mlmodel | ||||||||
deprecationDeprecation | Deprecation | ||||||||
dataPlatformInstanceDataPlatformInstance | The specific instance of the data platform that this entity belongs to | ||||||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from this entity Arguments
| ||||||||
lineageEntityLineageResult | Edges extending from this entity grouped by direction in the lineage graph Arguments
| ||||||||
browsePaths[BrowsePath!] | The browse paths corresponding to the ML Model. If no Browse Paths have been generated before, this will be null. | ||||||||
browsePathV2BrowsePathV2 | The browse path V2 corresponding to an entity. If no Browse Paths V2 have been generated before, this will be null. | ||||||||
glossaryTermsGlossaryTerms | The structured glossary terms associated with the entity | ||||||||
domainDomainAssociation | The Domain associated with the entity | ||||||||
editablePropertiesMLModelEditableProperties | An additional set of of read write properties | ||||||||
existsBoolean | Whether or not this entity exists on DataHub | ||||||||
aspects[RawAspect!] | Experimental API. For fetching extra entities that do not have custom UI code yet Arguments
| ||||||||
structuredPropertiesStructuredProperties | Structured properties about this asset | ||||||||
formsForms | The forms associated with the Dataset | ||||||||
privilegesEntityPrivileges | Privileges given to a user relevant to this entity | ||||||||
incidentsEntityIncidentsResult | Incidents associated with the ML Model Arguments
|
MLModelEditableProperties
Fields
Name | Description |
---|---|
descriptionString | The edited description |
MLModelFactorPrompts
Fields
Name | Description |
---|---|
relevantFactors[MLModelFactors!] | What are foreseeable salient factors for which MLModel performance may vary, and how were these determined |
evaluationFactors[MLModelFactors!] | Which factors are being reported, and why were these chosen |
MLModelFactors
Fields
Name | Description |
---|---|
groups[String!] | Distinct categories with similar characteristics that are present in the evaluation data instances |
instrumentation[String!] | Instrumentation used for MLModel |
environment[String!] | Environment in which the MLModel is deployed |
MLModelGroup
An ML Model Group Metadata Entity Note that this entity is incubating
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the ML Model Group | ||||
typeEntityType! | A standard Entity Type | ||||
lastIngestedLong | The timestamp for the last time this entity was ingested | ||||
nameString! | The display name for the Entity | ||||
platformDataPlatform! | Standardized platform urn where the MLModelGroup is defined | ||||
originFabricType! | Fabric type where MLModelGroup belongs to or where it was generated | ||||
descriptionString | Human readable description for MLModelGroup | ||||
propertiesMLModelGroupProperties | Additional read only properties about the ML Model Group | ||||
ownershipOwnership | Ownership metadata of the MLModelGroup | ||||
statusStatus | Status metadata of the MLModelGroup | ||||
deprecationDeprecation | Deprecation | ||||
dataPlatformInstanceDataPlatformInstance | The specific instance of the data platform that this entity belongs to | ||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from this entity Arguments
| ||||
lineageEntityLineageResult | Edges extending from this entity grouped by direction in the lineage graph Arguments
| ||||
browsePaths[BrowsePath!] | The browse paths corresponding to the ML Model Group. If no Browse Paths have been generated before, this will be null. | ||||
browsePathV2BrowsePathV2 | The browse path V2 corresponding to an entity. If no Browse Paths V2 have been generated before, this will be null. | ||||
tagsGlobalTags | Tags applied to entity | ||||
glossaryTermsGlossaryTerms | The structured glossary terms associated with the entity | ||||
domainDomainAssociation | The Domain associated with the entity | ||||
editablePropertiesMLModelGroupEditableProperties | An additional set of of read write properties | ||||
existsBoolean | Whether or not this entity exists on DataHub | ||||
aspects[RawAspect!] | Experimental API. For fetching extra entities that do not have custom UI code yet Arguments
| ||||
structuredPropertiesStructuredProperties | Structured properties about this asset | ||||
formsForms | The forms associated with the Dataset | ||||
privilegesEntityPrivileges | Privileges given to a user relevant to this entity |
MLModelGroupEditableProperties
Fields
Name | Description |
---|---|
descriptionString | The edited description |
MLModelGroupProperties
Fields
Name | Description |
---|---|
descriptionString | |
createdAtLong | |
versionVersionTag |
MLModelProperties
Fields
Name | Description |
---|---|
descriptionString | |
dateLong | |
versionString | |
typeString | |
hyperParametersHyperParameterMap | |
hyperParams[MLHyperParam] | |
trainingMetrics[MLMetric] | |
mlFeatures[String!] | |
tags[String!] | |
groups[MLModelGroup] | |
customProperties[CustomPropertiesEntry!] | |
externalUrlString |
MLPrimaryKey
An ML Primary Key Entity Note that this entity is incubating
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the ML Primary Key | ||||
typeEntityType! | A standard Entity Type | ||||
lastIngestedLong | The timestamp for the last time this entity was ingested | ||||
nameString! | The display name | ||||
featureNamespaceString! | MLPrimaryKey featureNamespace | ||||
descriptionString | MLPrimaryKey description | ||||
dataTypeMLFeatureDataType | MLPrimaryKey data type | ||||
propertiesMLPrimaryKeyProperties | Additional read only properties of the ML Primary Key | ||||
primaryKeyPropertiesMLPrimaryKeyProperties | Deprecated: No longer supported Deprecated, use properties field instead MLPrimaryKeyProperties | ||||
ownershipOwnership | Ownership metadata of the MLPrimaryKey | ||||
institutionalMemoryInstitutionalMemory | References to internal resources related to the MLPrimaryKey | ||||
statusStatus | Status metadata of the MLPrimaryKey | ||||
deprecationDeprecation | Deprecation | ||||
dataPlatformInstanceDataPlatformInstance | The specific instance of the data platform that this entity belongs to | ||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from this entity Arguments
| ||||
lineageEntityLineageResult | Edges extending from this entity grouped by direction in the lineage graph Arguments
| ||||
tagsGlobalTags | Tags applied to entity | ||||
glossaryTermsGlossaryTerms | The structured glossary terms associated with the entity | ||||
domainDomainAssociation | The Domain associated with the entity | ||||
editablePropertiesMLPrimaryKeyEditableProperties | An additional set of of read write properties | ||||
existsBoolean | Whether or not this entity exists on DataHub | ||||
aspects[RawAspect!] | Experimental API. For fetching extra entities that do not have custom UI code yet Arguments
| ||||
structuredPropertiesStructuredProperties | Structured properties about this asset | ||||
formsForms | The forms associated with the Dataset | ||||
privilegesEntityPrivileges | Privileges given to a user relevant to this entity |
MLPrimaryKeyEditableProperties
Fields
Name | Description |
---|---|
descriptionString | The edited description |
MLPrimaryKeyProperties
Fields
Name | Description |
---|---|
descriptionString | |
dataTypeMLFeatureDataType | |
versionVersionTag | |
sources[Dataset] |
NamedBar
For consumption by UI only
Fields
Name | Description |
---|---|
nameString! | |
segments[BarSegment!]! |
NamedLine
For consumption by UI only
Fields
Name | Description |
---|---|
nameString! | |
data[NumericDataPoint!]! |
Notebook
A Notebook Metadata Entity
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the Notebook | ||||
typeEntityType! | A standard Entity Type | ||||
toolString! | The Notebook tool name | ||||
notebookIdString! | An id unique within the Notebook tool | ||||
infoNotebookInfo | Additional read only information about the Notebook | ||||
editablePropertiesNotebookEditableProperties | Additional read write properties about the Notebook | ||||
ownershipOwnership | Ownership metadata of the Notebook | ||||
statusStatus | Status metadata of the Notebook | ||||
contentNotebookContent! | The content of this Notebook | ||||
tagsGlobalTags | The tags associated with the Notebook | ||||
institutionalMemoryInstitutionalMemory | References to internal resources related to the Notebook | ||||
domainDomainAssociation | The Domain associated with the Notebook | ||||
dataPlatformInstanceDataPlatformInstance | The specific instance of the data platform that this entity belongs to | ||||
relationshipsEntityRelationshipsResult | Edges extending from this entity Arguments
| ||||
subTypesSubTypes | Sub Types that this entity implements | ||||
glossaryTermsGlossaryTerms | The structured glossary terms associated with the notebook | ||||
platformDataPlatform! | Standardized platform. | ||||
browsePaths[BrowsePath!] | The browse paths corresponding to the Notebook. If no Browse Paths have been generated before, this will be null. | ||||
browsePathV2BrowsePathV2 | The browse path V2 corresponding to an entity. If no Browse Paths V2 have been generated before, this will be null. | ||||
existsBoolean | Whether or not this entity exists on DataHub | ||||
aspects[RawAspect!] | Experimental API. For fetching extra entities that do not have custom UI code yet Arguments
|
NotebookCell
The Union of every NotebookCell
Fields
Name | Description |
---|---|
chartCellChartCell | The chart cell content. The will be non-null only when all other cell field is null. |
textCellTextCell | The text cell content. The will be non-null only when all other cell field is null. |
queryChellQueryCell | The query cell content. The will be non-null only when all other cell field is null. |
typeNotebookCellType! | The type of this Notebook cell |
NotebookContent
The actual content in a Notebook
Fields
Name | Description |
---|---|
cells[NotebookCell!]! | The content of a Notebook which is composed by a list of NotebookCell |
NotebookEditableProperties
Notebook properties that are editable via the UI This represents logical metadata, as opposed to technical metadata
Fields
Name | Description |
---|---|
descriptionString | Description of the Notebook |
NotebookInfo
Additional read only information about a Notebook
Fields
Name | Description |
---|---|
titleString | Display of the Notebook |
descriptionString | Description of the Notebook |
externalUrlString | Native platform URL of the Notebook |
customProperties[CustomPropertiesEntry!] | A list of platform specific metadata tuples |
changeAuditStampsChangeAuditStamps | Captures information about who created/last modified/deleted this Notebook and when |
NumberValue
Numeric property value
Fields
Name | Description |
---|---|
numberValueFloat! | The value of a number type property |
NumericDataPoint
For consumption by UI only
Fields
Name | Description |
---|---|
xString! | |
yInt! |
Operation
Operational info for an entity.
Implements
Fields
Name | Description |
---|---|
timestampMillisLong! | The time at which the operation was reported |
actorString | Actor who issued this operation. |
operationTypeOperationType! | Operation type of change. |
customOperationTypeString | A custom operation type |
sourceTypeOperationSourceType | Source of the operation |
numAffectedRowsLong | How many rows were affected by this operation. |
affectedDatasets[String!] | Which other datasets were affected by this operation. |
lastUpdatedTimestampLong! | When time at which the asset was actually updated |
partitionString | Optional partition identifier |
customProperties[StringMapEntry!] | Custom operation properties |
Origin
Carries information about where an entity originated from.
Fields
Name | Description |
---|---|
typeOriginType! | Where an entity originated from. Either NATIVE or EXTERNAL |
externalTypeString | Only populated if type is EXTERNAL. The externalType of the entity, such as the name of the identity provider. |
Owner
An owner of a Metadata Entity
Fields
Name | Description |
---|---|
ownerOwnerType! | Owner object |
typeOwnershipType | Deprecated: No longer supported The type of the ownership. Deprecated - Use ownershipType field instead. |
ownershipTypeOwnershipTypeEntity | Ownership type information |
sourceOwnershipSource | Source information for the ownership |
associatedUrnString! | Reference back to the owned urn for tracking purposes e.g. when sibling nodes are merged together |
Ownership
Ownership information about a Metadata Entity
Fields
Name | Description |
---|---|
owners[Owner!] | List of owners of the entity |
lastModifiedAuditStamp! | Audit stamp containing who last modified the record and when |
OwnershipSource
Information about the source of Ownership metadata about a Metadata Entity
Fields
Name | Description |
---|---|
typeOwnershipSourceType! | The type of the source |
urlString | An optional reference URL for the source |
OwnershipTypeEntity
A single Custom Ownership Type
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | A primary key associated with the custom ownership type. | ||||
typeEntityType! | A standard Entity Type | ||||
infoOwnershipTypeInfo | Information about the Custom Ownership Type | ||||
statusStatus | Status of the Custom Ownership Type | ||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from the Custom Ownership Type Arguments
|
OwnershipTypeInfo
Properties about an individual Custom Ownership Type.
Fields
Name | Description |
---|---|
nameString! | The name of the Custom Ownership Type |
descriptionString | The description of the Custom Ownership Type |
createdAuditStamp | An Audit Stamp corresponding to the creation of this resource |
lastModifiedAuditStamp | An Audit Stamp corresponding to the update of this resource |
ParentContainersResult
All of the parent containers for a given entity. Returns parents with direct parent first followed by the parent's parent etc.
Fields
Name | Description |
---|---|
countInt! | The number of containers bubbling up for this entity |
containers[Container!]! | A list of parent containers in order from direct parent, to parent's parent etc. If there are no containers, return an emty list |
ParentDomainsResult
All of the parent domains starting from a single Domain through all of its ancestors
Fields
Name | Description |
---|---|
countInt! | The number of parent domains bubbling up for this entity |
domains[Entity!]! | A list of parent domains in order from direct parent, to parent's parent etc. If there are no parents, return an empty list |
ParentNodesResult
All of the parent nodes for GlossaryTerms and GlossaryNodes
Fields
Name | Description |
---|---|
countInt! | The number of parent nodes bubbling up for this entity |
nodes[GlossaryNode!]! | A list of parent nodes in order from direct parent, to parent's parent etc. If there are no nodes, return an empty list |
PartitionSpec
Information about the partition being profiled
Fields
Name | Description |
---|---|
typePartitionType! | The partition type |
partitionString | The partition identifier |
timePartitionTimeWindow | The optional time window partition information - required if type is TIMESTAMP_FIELD. |
PlatformPrivileges
The platform privileges that the currently authenticated user has
Fields
Name | Description |
---|---|
viewAnalyticsBoolean! | Whether the user should be able to view analytics |
managePoliciesBoolean! | Whether the user should be able to manage policies |
manageIdentitiesBoolean! | Whether the user should be able to manage users & groups |
generatePersonalAccessTokensBoolean! | Whether the user should be able to generate personal access tokens |
createDomainsBoolean! | Whether the user should be able to create new Domains |
manageDomainsBoolean! | Whether the user should be able to manage Domains |
manageIngestionBoolean! | Whether the user is able to manage UI-based ingestion |
manageSecretsBoolean! | Whether the user is able to manage UI-based secrets |
manageTokensBoolean! | Whether the user should be able to manage tokens on behalf of other users. |
viewTestsBoolean! | Whether the user is able to view Tests |
manageTestsBoolean! | Whether the user is able to manage Tests |
manageGlossariesBoolean! | Whether the user should be able to manage Glossaries |
manageUserCredentialsBoolean! | Whether the user is able to manage user credentials |
createTagsBoolean! | Whether the user should be able to create new Tags |
manageTagsBoolean! | Whether the user should be able to create and delete all Tags |
manageGlobalViewsBoolean! | Whether the user should be able to create, update, and delete global views. |
manageOwnershipTypesBoolean! | Whether the user should be able to create, update, and delete ownership types. |
manageGlobalAnnouncementsBoolean! | Whether the user can create and delete posts pinned to the home page. |
createBusinessAttributesBoolean! | Whether the user can create Business Attributes. |
manageBusinessAttributesBoolean! | Whether the user can manage Business Attributes. |
PoliciesConfig
Configurations related to the Policies Feature
Fields
Name | Description |
---|---|
enabledBoolean! | Whether the policies feature is enabled and should be displayed in the UI |
platformPrivileges[Privilege!]! | A list of platform privileges to display in the Policy Builder experience |
resourcePrivileges[ResourcePrivileges!]! | A list of resource privileges to display in the Policy Builder experience |
Policy
DEPRECATED TODO: Eventually get rid of this in favor of DataHub Policy An DataHub Platform Access Policy Access Policies determine who can perform what actions against which resources on the platform
Fields
Name | Description |
---|---|
urnString! | The primary key of the Policy |
typePolicyType! | The type of the Policy |
nameString! | The name of the Policy |
statePolicyState! | The present state of the Policy |
descriptionString | The description of the Policy |
resourcesResourceFilter | The resources that the Policy privileges apply to |
privileges[String!]! | The privileges that the Policy grants |
actorsActorFilter! | The actors that the Policy grants privileges to |
editableBoolean! | Whether the Policy is editable, ie system policies, or not |
PolicyMatchCriterion
Criterion to define relationship between field and values
Fields
Name | Description |
---|---|
fieldString! | The name of the field that the criterion refers to e.g. entity_type, entity_urn, domain |
values[PolicyMatchCriterionValue!]! | Values. Matches criterion if any one of the values matches condition (OR-relationship) |
conditionPolicyMatchCondition! | The name of the field that the criterion refers to |
PolicyMatchCriterionValue
Value in PolicyMatchCriterion with hydrated entity if value is urn
Fields
Name | Description |
---|---|
valueString! | The value of the field to match |
entityEntity | Hydrated entities of the above values. Only set if the value is an urn |
PolicyMatchFilter
Filter object that encodes a complex filter logic with OR + AND
Fields
Name | Description |
---|---|
criteria[PolicyMatchCriterion!] | List of criteria to apply |
Post
Input provided when creating a Post
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the Post | ||||
typeEntityType! | The standard Entity Type | ||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from the Post Arguments
| ||||
postTypePostType! | The type of post | ||||
contentPostContent! | The content of the post | ||||
lastModifiedAuditStamp! | When the post was last modified |
PostContent
Post content
Fields
Name | Description |
---|---|
contentTypePostContentType! | The type of post content |
titleString! | The title of the post |
descriptionString | Optional content of the post |
linkString | Optional link that the post is associated with |
mediaMedia | Optional media contained in the post |
Privilege
An individual DataHub Access Privilege
Fields
Name | Description |
---|---|
typeString! | Standardized privilege type, serving as a unique identifier for a privilege eg EDIT_ENTITY |
displayNameString | The name to appear when displaying the privilege, eg Edit Entity |
descriptionString | A description of the privilege to display |
Privileges
Object that encodes the privileges the actor has for a given resource
Fields
Name | Description |
---|---|
privileges[String!]! | Granted Privileges |
QuantitativeAnalyses
Fields
Name | Description |
---|---|
unitaryResultsResultsType | Link to a dashboard with results showing how the model performed with respect to each factor |
intersectionalResultsResultsType | Link to a dashboard with results showing how the model performed with respect to the intersection of evaluated factors |
QueriesTabConfig
Configuration for the queries tab
Fields
Name | Description |
---|---|
queriesTabResultSizeInt | Number of queries to show in the queries tab |
QueryCell
A Notebook cell which contains Query as content
Fields
Name | Description |
---|---|
cellTitleString! | Title of the cell |
cellIdString! | Unique id for the cell. |
changeAuditStampsChangeAuditStamps | Captures information about who created/last modified/deleted this TextCell and when |
rawQueryString! | Raw query to explain some specific logic in a Notebook |
lastExecutedAuditStamp | Captures information about who last executed this query cell and when |
QueryEntity
An individual Query
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | A primary key associated with the Query | ||||
typeEntityType! | A standard Entity Type | ||||
propertiesQueryProperties | Properties about the Query | ||||
subjects[QuerySubject!] | Subjects for the query | ||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from this entity Arguments
| ||||
platformDataPlatform | Platform from which the Query was detected |
QueryProperties
Properties about an individual Query
Fields
Name | Description |
---|---|
statementQueryStatement! | The Query statement itself |
sourceQuerySource! | The source of the Query |
nameString | The name of the Query |
descriptionString | The description of the Query |
createdAuditStamp! | An Audit Stamp corresponding to the creation of this resource |
lastModifiedAuditStamp! | An Audit Stamp corresponding to the update of this resource |
originEntity | The asset that this query originated from, e.g. a View, a dbt Model, etc. |
QueryStatement
An individual Query Statement
Fields
Name | Description |
---|---|
valueString! | The query statement value |
languageQueryLanguage! | The language for the Query Statement |
QuerySubject
The subject for a Query
Fields
Name | Description |
---|---|
datasetDataset! | The dataset which is the subject of the Query |
QuickFilter
A quick filter in search and auto-complete
Fields
Name | Description |
---|---|
fieldString! | Name of field to filter by |
valueString! | Value to filter on |
entityEntity | Entity that the value maps to if any |
RawAspect
Payload representing data about a single aspect
Fields
Name | Description |
---|---|
aspectNameString! | The name of the aspect |
payloadString | JSON string containing the aspect's payload |
renderSpecAspectRenderSpec | Details for the frontend on how the raw aspect should be rendered |
RecommendationContent
Content to display within each recommendation module
Fields
Name | Description |
---|---|
valueString! | String representation of content |
entityEntity | Entity being recommended. Empty if the content being recommended is not an entity |
paramsRecommendationParams | Additional context required to generate the the recommendation |
RecommendationModule
Fields
Name | Description |
---|---|
titleString! | Title of the module to display |
moduleIdString! | Unique id of the module being recommended |
renderTypeRecommendationRenderType! | Type of rendering that defines how the module should be rendered |
content[RecommendationContent!]! | List of content to display inside the module |
RecommendationParams
Parameters required to render a recommendation of a given type
Fields
Name | Description |
---|---|
searchParamsSearchParams | Context to define the search recommendations |
entityProfileParamsEntityProfileParams | Context to define the entity profile page |
contentParamsContentParams | Context about the recommendation |
RelationshipFieldMapping
ERModelRelationship FieldMap
Fields
Name | Description |
---|---|
sourceFieldString! | left field |
destinationFieldString! | bfield |
ResetToken
Token that allows native users to reset their credentials
Fields
Name | Description |
---|---|
resetTokenString! | The reset token |
ResolvedAuditStamp
Audit stamp containing a resolved actor
Fields
Name | Description |
---|---|
timeLong! | When the audited action took place |
actorCorpUser | Who performed the audited action |
ResourceFilter
The resources that a DataHub Access Policy applies to
Fields
Name | Description |
---|---|
typeString | The type of the resource the policy should apply to Not required because in the future we want to support filtering by type OR by domain |
resources[String!] | A list of specific resource urns to apply the filter to |
allResourcesBoolean | Whether of not to apply the filter to all resources of the type |
filterPolicyMatchFilter | Whether of not to apply the filter to all resources of the type |
ResourcePrivileges
A privilege associated with a particular resource type A resource is most commonly a DataHub Metadata Entity
Fields
Name | Description |
---|---|
resourceTypeString! | Resource type associated with the Access Privilege, eg dataset |
resourceTypeDisplayNameString | The name to used for displaying the resourceType |
entityTypeEntityType | An optional entity type to use when performing search and navigation to the entity |
privileges[Privilege!]! | A list of privileges that are supported against this resource |
Restricted
A restricted entity that the user does not have full permissions to view. This entity type does not relate to an entity type in the database.
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the restricted entity | ||||
typeEntityType! | The standard Entity Type | ||||
relationshipsEntityRelationshipsResult | Edges extending from this entity Arguments
| ||||
lineageEntityLineageResult | Edges extending from this entity grouped by direction in the lineage graph Arguments
|
Role
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | A primary key of the Metadata Entity | ||||
typeEntityType! | A standard Entity Type | ||||
relationshipsEntityRelationshipsResult | List of relationships between the source Entity and some destination entities with a given types Arguments
| ||||
idString! | Id of the Role | ||||
propertiesRoleProperties | Role properties to include Request Access Url | ||||
actorsActor | A standard Entity Type | ||||
isAssignedToMeBoolean! |
RoleAssociation
Fields
Name | Description |
---|---|
roleRole! | The Role entity itself |
associatedUrnString! | Reference back to the tagged urn for tracking purposes e.g. when sibling nodes are merged together |
RoleProperties
Fields
Name | Description |
---|---|
nameString! | Name of the Role in an organisation |
descriptionString | Description about the role |
typeString | Role type can be READ, WRITE or ADMIN |
requestUrlString | Url to request a role for a user in an organisation |
RoleUser
Fields
Name | Description |
---|---|
userCorpUser! | Linked corp user of a role |
Row
For consumption by UI only
Fields
Name | Description |
---|---|
values[String!]! | |
cells[Cell!] |
RowCountChange
Attributes defining an ROW_COUNT_CHANGE volume assertion.
Fields
Name | Description |
---|---|
typeAssertionValueChangeType! | The type of the value used to evaluate the assertion: a fixed absolute value or a relative percentage. |
operatorAssertionStdOperator! | The operator you'd like to apply. Note that only numeric operators are valid inputs: GREATER_THAN, GREATER_THAN_OR_EQUAL_TO, EQUAL_TO, LESS_THAN, LESS_THAN_OR_EQUAL_TO, BETWEEN. |
parametersAssertionStdParameters! | The parameters you'd like to provide as input to the operator. Note that only numeric parameter types are valid inputs: NUMBER. |
RowCountTotal
Attributes defining an ROW_COUNT_TOTAL volume assertion.
Fields
Name | Description |
---|---|
operatorAssertionStdOperator! | The operator you'd like to apply. Note that only numeric operators are valid inputs: GREATER_THAN, GREATER_THAN_OR_EQUAL_TO, EQUAL_TO, LESS_THAN, LESS_THAN_OR_EQUAL_TO, BETWEEN. |
parametersAssertionStdParameters! | The parameters you'd like to provide as input to the operator. Note that only numeric parameter types are valid inputs: NUMBER. |
Schema
Deprecated, use SchemaMetadata instead Metadata about a Dataset schema
Fields
Name | Description |
---|---|
datasetUrnString | Dataset this schema metadata is associated with |
nameString! | Schema name |
platformUrnString! | Platform this schema metadata is associated with |
versionLong! | The version of the GMS Schema metadata |
clusterString | The cluster this schema metadata is derived from |
hashString! | The SHA1 hash of the schema content |
platformSchemaPlatformSchema | The native schema in the datasets platform, schemaless if it was not provided |
fields[SchemaField!]! | Client provided a list of fields from value schema |
primaryKeys[String!] | Client provided list of fields that define primary keys to access record |
foreignKeys[ForeignKeyConstraint] | Client provided list of foreign key constraints |
createdAtLong | The time at which the schema metadata information was created |
lastObservedLong | The time at which the schema metadata information was last ingested |
SchemaAssertionField
Defines a schema field, each with a specified path and type.
Fields
Name | Description |
---|---|
pathString! | The standard V1 path of the field within the schema. |
typeSchemaFieldDataType! | The std type of the field |
nativeTypeString | Optional: The specific native or standard type of the field. |
SchemaAssertionInfo
Information about an Schema assertion
Fields
Name | Description |
---|---|
entityUrnString! | The entity targeted by this schema assertion. |
fields[SchemaAssertionField!]! | A single field in the schema assertion. |
schemaSchemaMetadata | A definition of the expected structure for the asset Deprecated! Use the simpler 'fields' instead. |
compatibilitySchemaAssertionCompatibility! | The compatibility level required for the assertion to pass. |
SchemaContract
Fields
Name | Description |
---|---|
assertionAssertion! | The assertion representing the schema contract. |
SchemaField
Information about an individual field in a Dataset schema
Fields
Name | Description |
---|---|
fieldPathString! | Flattened name of the field computed from jsonPath field |
jsonPathString | Flattened name of a field in JSON Path notation |
labelString | Human readable label for the field. Not supplied by all data sources |
nullableBoolean! | Indicates if this field is optional or nullable |
descriptionString | Description of the field |
typeSchemaFieldDataType! | Platform independent field type of the field |
nativeDataTypeString | The native type of the field in the datasets platform as declared by platform schema |
recursiveBoolean! | Whether the field references its own type recursively |
globalTagsGlobalTags | Deprecated: No longer supported Deprecated, use tags field instead Tags associated with the field |
tagsGlobalTags | Tags associated with the field |
glossaryTermsGlossaryTerms | Glossary terms associated with the field |
isPartOfKeyBoolean | Whether the field is part of a key schema |
isPartitioningKeyBoolean | Whether the field is part of a partitioning key schema |
jsonPropsString | For schema fields that have other properties that are not modeled explicitly, represented as a JSON string. |
schemaFieldEntitySchemaFieldEntity | Schema field entity that exist in the database for this schema field |
SchemaFieldBlame
Blame for a single field
Fields
Name | Description |
---|---|
fieldPathString! | Flattened name of a schema field |
schemaFieldChangeSchemaFieldChange! | Attributes identifying a field change |
SchemaFieldChange
Attributes identifying a field change
Fields
Name | Description |
---|---|
timestampMillisLong! | The time at which the schema was updated |
lastSemanticVersionString! | The last semantic version that this schema was changed in |
versionStampString! | Version stamp of the change |
changeTypeChangeOperationType! | The type of the change |
lastSchemaFieldChangeString | Last column update, such as Added/Modified/Removed in v1.2.3. |
SchemaFieldEntity
Standalone schema field entity. Differs from the SchemaField struct because it is not directly nested inside a schema field
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | Primary key of the schema field | ||||
typeEntityType! | A standard Entity Type | ||||
fieldPathString! | Field path identifying the field in its dataset | ||||
parentEntity! | The field's parent. | ||||
structuredPropertiesStructuredProperties | Structured properties on this schema field | ||||
formsForms | The forms associated with the Dataset | ||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from this entity Arguments
| ||||
businessAttributesBusinessAttributes | Business Attribute associated with the field | ||||
documentationDocumentation | Documentation aspect for this schema field |
SchemaFieldRef
A Dataset schema field (i.e. column)
Fields
Name | Description |
---|---|
urnString! | A schema field urn |
pathString! | A schema field path |
SchemaFieldSpec
Information about the field to use in an assertion
Fields
Name | Description |
---|---|
pathString! | The field path |
typeString! | The DataHub standard schema field type. |
nativeTypeString! | The native field type |
SchemaMetadata
Metadata about a Dataset schema
Implements
Fields
Name | Description |
---|---|
aspectVersionLong | The logical version of the schema metadata, where zero represents the latest version with otherwise monotonic ordering starting at one |
datasetUrnString | Dataset this schema metadata is associated with |
nameString! | Schema name |
platformUrnString! | Platform this schema metadata is associated with |
versionLong! | The version of the GMS Schema metadata |
clusterString | The cluster this schema metadata is derived from |
hashString! | The SHA1 hash of the schema content |
platformSchemaPlatformSchema | The native schema in the datasets platform, schemaless if it was not provided |
fields[SchemaField!]! | Client provided a list of fields from value schema |
primaryKeys[String!] | Client provided list of fields that define primary keys to access record |
foreignKeys[ForeignKeyConstraint] | Client provided list of foreign key constraints |
createdAtLong | The time at which the schema metadata information was created |
ScrollAcrossLineageResults
Results returned by issuing a search across relationships query using scroll API
Fields
Name | Description |
---|---|
nextScrollIdString | Opaque ID to pass to the next request to the server |
countInt! | The number of entities included in the result set |
totalInt! | The total number of search results matching the query and filters |
searchResults[SearchAcrossLineageResult!]! | The search result entities |
facets[FacetMetadata!] | Candidate facet aggregations used for search filtering |
ScrollResults
Results returned by issuing a search query
Fields
Name | Description |
---|---|
nextScrollIdString | Opaque ID to pass to the next request to the server |
countInt! | The number of entities included in the result set |
totalInt! | The total number of search results matching the query and filters |
searchResults[SearchResult!]! | The search result entities for a scroll request |
facets[FacetMetadata!] | Candidate facet aggregations used for search filtering |
SearchAcrossLineageResult
Individual search result from a search across relationships query (has added metadata about the path)
Fields
Name | Description |
---|---|
entityEntity! | The resolved DataHub Metadata Entity matching the search query |
insights[SearchInsight!] | Insights about why the search result was matched |
matchedFields[MatchedField!]! | Matched field hint |
paths[EntityPath] | Optional list of entities between the source and destination node |
degreeInt! | Degree of relationship (number of hops to get to entity) |
degrees[Int!] | Degrees of relationship (for entities discoverable at multiple degrees) |
exploredBoolean! | Marks whether or not this entity was explored further for lineage |
truncatedChildrenBoolean! | Indicates this destination node has additional unexplored child relationships |
ignoredAsHopBoolean! | Whether this relationship was ignored as a hop |
SearchAcrossLineageResults
Results returned by issuing a search across relationships query
Fields
Name | Description |
---|---|
startInt! | The offset of the result set |
countInt! | The number of entities included in the result set |
totalInt! | The total number of search results matching the query and filters |
searchResults[SearchAcrossLineageResult!]! | The search result entities |
facets[FacetMetadata!] | Candidate facet aggregations used for search filtering |
freshnessFreshnessStats | Optional freshness characteristics of this query (cached, staleness etc.) |
SearchInsight
Insights about why a search result was returned or ranked in the way that it was
Fields
Name | Description |
---|---|
textString! | The insight to display |
iconString | An optional emoji to display in front of the text |
SearchParams
Context to define the search recommendations
Fields
Name | Description |
---|---|
types[EntityType!] | Entity types to be searched. If this is not provided, all entities will be searched. |
queryString! | Search query |
filters[FacetFilter!] | Filters |
SearchResult
An individual search result hit
Fields
Name | Description |
---|---|
entityEntity! | The resolved DataHub Metadata Entity matching the search query |
insights[SearchInsight!] | Insights about why the search result was matched |
matchedFields[MatchedField!]! | Matched field hint |
extraProperties[ExtraProperty!] | Additional properties about the search result. Used for rendering in the UI |
SearchResults
Results returned by issuing a search query
Fields
Name | Description |
---|---|
startInt! | The offset of the result set |
countInt! | The number of entities included in the result set |
totalInt! | The total number of search results matching the query and filters |
searchResults[SearchResult!]! | The search result entities |
facets[FacetMetadata!] | Candidate facet aggregations used for search filtering |
suggestions[SearchSuggestion!] | Search suggestions based on the query provided for alternate query texts |
SearchResultsVisualConfig
Configuration for a search result
Fields
Name | Description |
---|---|
enableNameHighlightBoolean | Whether a search result should highlight the name/description if it was matched on those fields. |
SearchSuggestion
A suggestion for an alternate search query given an original query compared to all of the entity names in our search index.
Fields
Name | Description |
---|---|
textString! | The suggested text based on the provided query text compared to the entity name field in the search index. |
scoreFloat | The "edit distance" for this suggestion. The closer this number is to 1, the closer the suggested text is to the original text. The closer it is to 0, the further from the original text it is. |
frequencyInt | The number of entities that would match on the name field given the suggested text |
Secret
A referencible secret stored in DataHub's system. Notice that we do not return the actual secret value.
Fields
Name | Description |
---|---|
urnString! | The urn of the secret |
nameString! | The name of the secret |
descriptionString | An optional description for the secret |
SecretValue
A plaintext secret value
Fields
Name | Description |
---|---|
nameString! | The name of the secret |
valueString! | The plaintext value of the secret. |
SemanticVersionStruct
Properties identify a semantic version
Fields
Name | Description |
---|---|
semanticVersionString | Semantic version of the change |
semanticVersionTimestampLong | Semantic version timestamp |
versionStampString | Version stamp of the change |
SiblingProperties
Metadata about the entity's siblings
Fields
Name | Description |
---|---|
isPrimaryBoolean | If this entity is the primary sibling among the sibling set |
siblings[Entity] | The sibling entities |
SourceCode
Fields
Name | Description |
---|---|
sourceCode[SourceCodeUrl!] | Source Code along with types |
SourceCodeUrl
Fields
Name | Description |
---|---|
typeSourceCodeUrlType! | Source Code Url Types |
sourceCodeUrlString! | Source Code Url |
SqlAssertionInfo
Attributes defining a SQL Assertion
Fields
Name | Description |
---|---|
typeSqlAssertionType! | The type of the SQL assertion being monitored. |
entityUrnString! | The entity targeted by this SQL check. |
statementString! | The SQL statement to be executed when evaluating the assertion. |
changeTypeAssertionValueChangeType | The type of the value used to evaluate the assertion: a fixed absolute value or a relative percentage. Required if the type is METRIC_CHANGE. |
operatorAssertionStdOperator! | The operator you'd like to apply to the result of the SQL query. |
parametersAssertionStdParameters! | The parameters you'd like to provide as input to the operator. |
Status
The status of a particular Metadata Entity
Fields
Name | Description |
---|---|
removedBoolean! | Whether the entity is removed or not |
StepStateResult
A single step state
Fields
Name | Description |
---|---|
idString! | Unique id of the step |
properties[StringMapEntry!]! | The properties for the step state |
StringBox
Fields
Name | Description |
---|---|
stringValueString! |
StringMapEntry
An entry in a string string map represented as a tuple
Fields
Name | Description |
---|---|
keyString! | The key of the map entry |
valueString | The value fo the map entry |
StringValue
String property value
Fields
Name | Description |
---|---|
stringValueString! | The value of a string type property |
StructuredProperties
Object containing structured properties for an entity
Fields
Name | Description |
---|---|
properties[StructuredPropertiesEntry!] | Structured properties on this entity |
StructuredPropertiesEntry
An entry in an structured properties list represented as a tuple
Fields
Name | Description |
---|---|
structuredPropertyStructuredPropertyEntity! | The key of the map entry |
values[PropertyValue]! | The values of the structured property for this entity |
valueEntities[Entity] | The optional entities associated with the values if the values are entity urns |
StructuredPropertyDefinition
Properties about an individual Query
Fields
Name | Description |
---|---|
qualifiedNameString! | The fully qualified name of the property. This includes its namespace |
displayNameString | The display name of this structured property |
descriptionString | The description of this property |
cardinalityPropertyCardinality | The cardinality of a Structured Property determining whether one or multiple values can be applied to the entity from this property. |
allowedValues[AllowedValue!] | A list of allowed values that the property is allowed to take. |
valueTypeDataTypeEntity! | The type of this structured property |
typeQualifierTypeQualifier | Allows for type specialization of the valueType to be more specific about which entity types are allowed, for example. |
entityTypes[EntityTypeEntity!]! | Entity types that this structured property can be applied to |
immutableBoolean! | Whether or not this structured property is immutable |
createdResolvedAuditStamp | Audit stamp for when this structured property was created |
lastModifiedResolvedAuditStamp | Audit stamp for when this structured property was last modified |
StructuredPropertyEntity
A structured property that can be shared between different entities
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | A primary key associated with the structured property | ||||
typeEntityType! | A standard Entity Type | ||||
existsBoolean | Whether or not this entity exists on DataHub | ||||
definitionStructuredPropertyDefinition! | Definition of this structured property including its name | ||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from this entity Arguments
|
StructuredPropertyParams
A prompt shown to the user to collect metadata about an entity
Fields
Name | Description |
---|---|
structuredPropertyStructuredPropertyEntity! | The structured property required for the prompt on this entity |
StructuredReport
A flexible carrier for structured results of an execution request.
Fields
Name | Description |
---|---|
typeString! | The type of the structured report. (e.g. INGESTION_REPORT, TEST_CONNECTION_REPORT, etc.) |
serializedValueString! | The serialized value of the structured report |
contentTypeString! | The content-type of the serialized value (e.g. application/json, application/json;gzip etc.) |
SubTypes
Fields
Name | Description |
---|---|
typeNames[String!] | The sub-types that this entity implements. e.g. Datasets that are views will implement the "view" subtype |
SystemFreshness
Fields
Name | Description |
---|---|
systemNameString! | Name of the system |
freshnessMillisLong! | The latest timestamp in millis of the system that was used to respond to this query In case a cache was consulted, this reflects the freshness of the cache In case an index was consulted, this reflects the freshness of the index |
TableChart
For consumption by UI only
Fields
Name | Description |
---|---|
titleString! | |
columns[String!]! | |
rows[Row!]! |
TableSchema
Information about a raw Table Schema
Fields
Name | Description |
---|---|
schemaString! | Raw table schema |
Tag
A Tag Entity, which can be associated with other Metadata Entities and subresources
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the TAG | ||||
typeEntityType! | A standard Entity Type | ||||
nameString! | Deprecated: No longer supported A unique identifier for the Tag. Deprecated - Use properties.name field instead. | ||||
propertiesTagProperties | Additional properties about the Tag | ||||
editablePropertiesEditableTagProperties | Deprecated: No longer supported Additional read write properties about the Tag Deprecated! Use 'properties' field instead. | ||||
ownershipOwnership | Ownership metadata of the dataset | ||||
relationshipsEntityRelationshipsResult | Granular API for querying edges extending from this entity Arguments
| ||||
descriptionString | Deprecated: No longer supported Deprecated, use properties.description field instead | ||||
aspects[RawAspect!] | Experimental API. For fetching extra entities that do not have custom UI code yet Arguments
|
TagAssociation
An edge between a Metadata Entity and a Tag Modeled as a struct to permit additional attributes TODO Consider whether this query should be serviced by the relationships field
Fields
Name | Description |
---|---|
tagTag! | The tag itself |
associatedUrnString! | Reference back to the tagged urn for tracking purposes e.g. when sibling nodes are merged together |
TagProperties
Properties for a DataHub Tag
Fields
Name | Description |
---|---|
nameString! | A display name for the Tag |
descriptionString | A description of the Tag |
colorHexString | An optional RGB hex code for a Tag color, e.g. #FFFFFF |
TelemetryConfig
Configurations related to tracking users in the app
Fields
Name | Description |
---|---|
enableThirdPartyLoggingBoolean | Env variable for whether or not third party logging should be enabled for this instance |
Test
A metadata entity representing a DataHub Test
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the Test itself | ||||
typeEntityType! | The standard Entity Type | ||||
nameString! | The name of the Test | ||||
categoryString! | The category of the Test (user defined) | ||||
descriptionString | Description of the test | ||||
definitionTestDefinition! | Definition for the test | ||||
relationshipsEntityRelationshipsResult | Unused for tests Arguments
|
TestDefinition
Definition of the test
Fields
Name | Description |
---|---|
jsonString | JSON-based def for the test Deprecated! JSON representation is no longer supported. |
TestResult
The result of running a test
Fields
Name | Description |
---|---|
testTest | The test itself, or null if the test has been deleted |
typeTestResultType! | The final result, e.g. either SUCCESS or FAILURE. |
TestResults
A set of test results
Fields
Name | Description |
---|---|
passing[TestResult!]! | The tests passing |
failing[TestResult!]! | The tests failing |
TestsConfig
Configurations related to DataHub Tests feature
Fields
Name | Description |
---|---|
enabledBoolean! | Whether Tests feature is enabled |
TextCell
A Notebook cell which contains text as content
Fields
Name | Description |
---|---|
cellTitleString! | Title of the cell |
cellIdString! | Unique id for the cell. |
changeAuditStampsChangeAuditStamps | Captures information about who created/last modified/deleted this TextCell and when |
textString! | The actual text in a TextCell in a Notebook |
TimeSeriesChart
For consumption by UI only
Fields
Name | Description |
---|---|
titleString! | |
lines[NamedLine!]! | |
dateRangeDateRange! | |
intervalDateInterval! |
TimeWindow
A time window with a finite start and end time
Fields
Name | Description |
---|---|
startTimeMillisLong! | The start time of the time window |
durationMillisLong! | The end time of the time window |
TypeQualifier
Allows for type specialization of the valueType to be more specific about which entity types are allowed, for example.
Fields
Name | Description |
---|---|
allowedTypes[EntityTypeEntity!] | The list of allowed entity types |
UpdateStepStateResult
Result returned when fetching step state
Fields
Name | Description |
---|---|
idString! | Id of the step |
succeededBoolean! | Whether the update succeeded. |
UpstreamEntityRelationships
Deprecated, use relationships query instead
Fields
Name | Description |
---|---|
entities[EntityRelationshipLegacy] |
UsageAggregation
An aggregation of Dataset usage statistics
Fields
Name | Description |
---|---|
bucketLong | The time window start time |
durationWindowDuration | The time window span |
resourceString | The resource urn associated with the usage information, eg a Dataset urn |
metricsUsageAggregationMetrics | The rolled up usage metrics |
UsageAggregationMetrics
Rolled up metrics about Dataset usage over time
Fields
Name | Description |
---|---|
uniqueUserCountInt | The unique number of users who have queried the dataset within the time range |
users[UserUsageCounts] | Usage statistics within the time range by user |
totalSqlQueriesInt | The total number of queries issued against the dataset within the time range |
topSqlQueries[String] | A set of common queries issued against the dataset within the time range |
fields[FieldUsageCounts] | Per field usage statistics within the time range |
UsageQueryResult
The result of a Dataset usage query
Fields
Name | Description |
---|---|
buckets[UsageAggregation] | A set of relevant time windows for use in displaying usage statistics |
aggregationsUsageQueryResultAggregations | A set of rolled up aggregations about the Dataset usage |
UsageQueryResultAggregations
A set of rolled up aggregations about the Dataset usage
Fields
Name | Description |
---|---|
uniqueUserCountInt | The count of unique Dataset users within the queried time range |
users[UserUsageCounts] | The specific per user usage counts within the queried time range |
fields[FieldUsageCounts] | The specific per field usage counts within the queried time range |
totalSqlQueriesInt | The total number of queries executed within the queried time range Note that this field will likely be deprecated in favor of a totalQueries field |
UserUsageCounts
Information about individual user usage of a Dataset
Fields
Name | Description |
---|---|
userCorpUser | The user of the Dataset |
countInt | The number of queries issued by the user |
userEmailString | The extracted user email Note that this field will soon be deprecated and merged with user |
VersionedDataset
A Dataset entity, which encompasses Relational Tables, Document store collections, streaming topics, and other sets of data having an independent lifecycle
Implements
Fields
Name | Description | ||||
---|---|---|---|---|---|
urnString! | The primary key of the Dataset | ||||
typeEntityType! | The standard Entity Type | ||||
platformDataPlatform! | Standardized platform urn where the dataset is defined | ||||
containerContainer | The parent container in which the entity resides | ||||
parentContainersParentContainersResult | Recursively get the lineage of containers for this entity | ||||
nameString! | Unique guid for dataset No longer to be used as the Dataset display name. Use properties.name instead | ||||
propertiesDatasetProperties | An additional set of read only properties | ||||
editablePropertiesDatasetEditableProperties | An additional set of of read write properties | ||||
ownershipOwnership | Ownership metadata of the dataset | ||||
deprecationDeprecation | The deprecation status of the dataset | ||||
institutionalMemoryInstitutionalMemory | References to internal resources related to the dataset | ||||
editableSchemaMetadataEditableSchemaMetadata | Editable schema metadata of the dataset | ||||
statusStatus | Status of the Dataset | ||||
tagsGlobalTags | Tags used for searching dataset | ||||
glossaryTermsGlossaryTerms | The structured glossary terms associated with the dataset | ||||
domainDomainAssociation | The Domain associated with the Dataset | ||||
health[Health!] | Experimental! The resolved health status of the asset | ||||
schemaSchema | Schema metadata of the dataset | ||||
subTypesSubTypes | Sub Types that this entity implements | ||||
viewPropertiesViewProperties | View related properties. Only relevant if subtypes field contains view. | ||||
originFabricType! | Deprecated: No longer supported Deprecated, see the properties field instead Environment in which the dataset belongs to or where it was generated Note that this field will soon be deprecated in favor of a more standardized concept of Environment | ||||
relationshipsEntityRelationshipsResult | Deprecated: No longer supported No-op, has to be included due to model Arguments
|
VersionTag
The technical version associated with a given Metadata Entity
Fields
Name | Description |
---|---|
versionTagString |
ViewProperties
Properties about a Dataset of type view
Fields
Name | Description |
---|---|
materializedBoolean! | Whether the view is materialized or not |
logicString! | The logic associated with the view, most commonly a SQL statement |
formattedLogicString | A formatted version of the logic associated with the view. For dbt, this contains the compiled SQL. |
languageString! | The language in which the view logic is written, for example SQL |
ViewsConfig
Configurations related to DataHub Views feature
Fields
Name | Description |
---|---|
enabledBoolean! | Whether Views feature is enabled |
VisualConfig
Configurations related to visual appearance of the app
Fields
Name | Description |
---|---|
logoUrlString | Custom logo url for the homepage & top banner |
faviconUrlString | Custom favicon url for the homepage & top banner |
appTitleString | Custom app title to show in the browser tab |
hideGlossaryBoolean | Boolean flag disabling viewing the Business Glossary page for users without the 'Manage Glossaries' privilege |
queriesTabQueriesTabConfig | Configuration for the queries tab |
entityProfilesEntityProfilesConfig | Configuration for the queries tab |
searchResultSearchResultsVisualConfig | Configuration for search results |
VolumeAssertionInfo
A definition of a Volume (row count) assertion.
Fields
Name | Description |
---|---|
entityUrnString! | The entity targeted by this Volume check. |
typeVolumeAssertionType! | The type of the freshness assertion being monitored. |
rowCountTotalRowCountTotal | Produce FAILURE Assertion Result if the row count of the asset does not meet specific requirements. Required if type is 'ROW_COUNT_TOTAL'. |
rowCountChangeRowCountChange | Produce FAILURE Assertion Result if the row count delta of the asset does not meet specific requirements. Required if type is 'ROW_COUNT_CHANGE'. |
incrementingSegmentRowCountTotalIncrementingSegmentRowCountTotal | Produce FAILURE Assertion Result if the latest incrementing segment row count total of the asset does not meet specific requirements. Required if type is 'INCREMENTING_SEGMENT_ROW_COUNT_TOTAL'. |
incrementingSegmentRowCountChangeIncrementingSegmentRowCountChange | Produce FAILURE Assertion Result if the incrementing segment row count delta of the asset does not meet specific requirements. Required if type is 'INCREMENTING_SEGMENT_ROW_COUNT_CHANGE'. |
filterDatasetFilter | A definition of the specific filters that should be applied, when performing monitoring. If not provided, there is no filter, and the full table is under consideration. |