Skip to main content

7/04 - Job Cloning

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for MongoDb TLS certificates for TLS
  2. Added support for MongoDb connection pooling
  3. Added support for the ability to clone a job
  4. Added support for Google Cloud Storage as a destination connection
  5. Added support for publishing to Artifact hub
  6. Added a batch size config option to the OpenAI generator
  7. Added support for being able to use generators and transformers inside of the javascript transformers
  8. Better handling of OpenAI generator token limits
  9. Added support for configuring sidecars in helm charts

6/20 - MongoDb

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for MongoDb as a connection
  2. Updated Linux support so that you can run the gen.sh script to stand up environment locally
  3. Updated Supabase connection to pull in the schema role permission correctly
  4. Updated worker to handle newer SQL compliant syntax for defining auto-incrementing columns
  5. Added support for identity columns in Postgres
  6. Updated circular dependencies to handle complex dependencies with subsets

6/06 - Real time schema validation

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for Postgres Client Certificates
  2. Added support for creating table indices on init
  3. Added support for real time constraint validation
  4. Added an option to the email transformer to handle invalid email addresses
  5. Added root label to the subset page to denote root tables for subsetting
  6. Added button to get the row count of a subsetted table
  7. Added support for Postgres custom datatypes/functions/sequences etc
  8. Added support for column auto-complete within subsetted
  9. Fixed a bug that was causing mysql system queries to use int32 instead of int64
  10. Various UI/UX refinements

5/23 - Flexible Schema References

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for JSONB columns in subsetting section
  2. Updated error handling to be more responsive in worker
  3. Fixed a bug that was causing the init schema to skip on generate jobs
  4. Update Terraform provider to retrieve system transformer by source
  5. Exposed a logout Url override in the helm chart
  6. Added support for Float transformer precision
  7. Added support for unique email addresses in email transformer
  8. Fixed a bug that was causing truncate to fail before an insert when there was only a single table
  9. Added support for selecting a different connection that we pull the schema from which doesn't have to be the destination
  10. Various UI/UX refinements

5/7 - AI Generated Synthetic Data

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for AI generated synthetic data
  2. Support popping a missing column from the jobs mapping table to update mappings
  3. Support searching in the subset table
  4. Support the Transform Javascript transformer on foreign keys
  5. Support for generated columns
  6. New connection page now filters to correct database type based on source connection
  7. Transformer column in the job mapping page is now searchable
  8. Support for setting the precision in the Float64 transformers
  9. Job Mapping page list boxes now take the account into consideration when filtering
  10. Added support for unique email addresses in the Email Transformers
  11. Various UI/UX refinements

4/25 - Postgres Permissions

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support and granularity for Postgres Permissions
  2. Add support for Composite keys in subsets
  3. Fixed a bug that was causing foreign keys to not entirely subset correctly
  4. Fixed a bug that was causing new columns to not show up on the job details page
  5. Updated custom javascript transformers to check for account ownership
  6. Various UI/UX refinements

4/11 - Custom Generate Transformers

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Add the ability to write custom javascript Transformers for a data generate job
  2. Transformers now filter by data type in the schema page to prevent type mismatches
  3. Add in self-service sign ups for the free tier
  4. Reduced data generation and sync time by 50%
  5. Logs in runs now are persistent, searchable and filterable
  6. Support for setting max connection limits for connections and pooled connections
  7. Added support for ON CONFLICT to handle duplicate rows
  8. Updated retry policy to fail fast instead of waiting to fail leading to better performance
  9. Update schedules to ensure that they don't get culled by Temporal
  10. Support the ability to delete, cancel or terminate runs from the Jobs page instead of having to go to Runs
  11. Various UI/UX refinements

3/28 - Partial Table Syncs

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for partial table syncs
  2. Added support for real-time validation for schema mapping
  3. Added support for permission validation for connections
  4. Added support for passing in a connection string instead of always parsing out connection parameters
  5. Added support for referential integrity in subsetting
  6. Updated schema mapping page to show unique constraints in table
  7. Updated helm charts to allow users to configure the update strategy
  8. Updated transformation logic to fail fast if transformer is unable to insert
  9. Updated transformers to have significantly more entropy
  10. Added sorting to Transformers to make it easier to search and filter
  11. Added a default schedule for jobs
  12. Various UI/UX refinements

3/14 - Metrics

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for a Supabase Integration
  2. Added the ability to easily clone a connection
  3. Updated streaming infrastructure to used pooled connections for more efficient data transfer
  4. Added a product tour checklist to make onboarding easier
  5. Added more UI support for foreign key transformations
  6. Implemented Keycloak for authentication and removed Auth0
  7. Other UI/UX refinements

2/29 - Foreign Key Transformations

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Support primary key and foreign key transformations
  2. Include constraints in Schema table for filtering, searching, sorting
  3. Update SSH tunnel session sharing to be much more efficient
  4. Update job details to surface an error if the job times out
  5. Add isNullable column to the Schema table
  6. Add regular expression to character scramble transformer
  7. Update sync job to handle reserved keyword columns
  8. Handle column lengths in data generation so that we never overflow a column
  9. Fixed a bug that broke the data generation form when you switch tables
  10. UI/UX refinements