I’m currently working on a project in Palantir Foundry where I’m creating a Quiver dashboard. The dashboard uses a Transform Table to join data from multiple source transform tables. I’m …

Oct 29, 2022 · Foundry has ~delta/iceberg in-built since the beginning (2017/18) which means you can do Schema evolution, time travel, zero cost copy of datasets etc. within Foundry. A …

Aug 3, 2022 · We try to create a test function for the whole transformation. import os from transforms.verbs.testing.TransformRunner import TransformRunner from transforms.api …

Had some experience with palantir foundry as they tried to court my previous company to switch over from databricks. Palantir foundry was found to be more expensive and had a few less …

Jun 19, 2023 · I would like a transformation to be run on a group of datasets, like all the datasets in a folder. The use case is that I have users that need to upload multiple groups of JSON files …

May 6, 2022 · How can I pass through dataset metadata, like a hash or timestamp, in a Python Transform in Palantir Foundry? 1 how to I use below import statement in palantir foundry: …

Oct 19, 2020 · Hence my recommendation is to always consider using workshop first. If you have a workflow that's almost possible to implement in workshop, but there's just some small …

Jun 23, 2023 · Problem context: I would like to apply a transform to all the datasets in a folder. I am using the Compass Files Lister Logic Flow which generates a list of resource IDs stored in …

Jan 9, 2022 · Because Foundry datasets store raw files, a simple Python transform using shutil.copyfileobj should do the trick. This is further documented under Palantir docs: …

To me it looks like Palantir is artificially (argument: "we want to have the full lineage captured") restricting the ability to access any dataset that is not mentioned in your transform decorator. I …