The Movies I Watched in 2018

I didn’t watch as many movies in 2018 as I had in previous years, but I still did pretty well by most standards. I ended up watching 413 movies in a theater and 378 outside of a theater, for a total of 791 total.

The only movies I saw in a theater were at an Alamo Drafthouse (335 movies) or at the Austin Film Society (78 movies). 267 of those movies were projected digitally, 137 on film (126 in 35mm, 6 in 16mm, and 5 in 70mm), and 9 were on VHS.

The best new releases I saw in the theater include:

  • Bad Times at the El Royale
  • Border
  • Green Book
  • The Guilty
  • Hold the Dark
  • I Don’t Feel at Home in This World Anymore
  • Incredibles 2
  • Juliet, Naked
  • Love, Simon
  • Lowlife
  • Paddington 2
  • Princess Cyd
  • Ready Player One
  • RBG
  • A Simple Favor
  • The Shape of Water
  • Sweet Country
  • Three Identical Strangers
  • Thunder Road
  • Won’t You Be My Neighbor?

I also saw some great new movies at the Fantastic Fest film festival, but I’m not sure that they have been officially released yet. The best of them include:

  • The Boat
  • Chained for Life
  • Goliath
  • Slut in a Good Way
  • The Standoff at Sparrow Creek
  • The Unthinkable
  • The World Is Yours

And even if I didn’t think they were the best in a conventional sense, I had a heck of a good time watching a few other new releases:

  • Between Worlds (though I don’t think it’s actually out yet)
  • The Meg
  • Twisted Pair

And these surprised me by being quite a bit better than I expected, even if they’re not among the best of the year:

  • Blockers
  • Game Night
  • Tag

On the other hand, these were the new releases that everyone else seemed to love, but I strongly disliked:

  • The Favourite
  • Ghost Stories
  • Hereditary
  • Mandy
  • Mission: Impossible — Fallout
  • A Quiet Place

And one of the great things about the film scene in Austin is that we get to watch a ton of repertory films on the big screen. The best older movies I saw for the first time in 2018 included:

  • The Awful Truth (1937)
  • The Big Heat (1953)
  • Bunny Lake Is Missing (1965)
  • Colossus: The Forbin Project (1970)
  • Coming Home (1978)
  • Deadly Games (aka Dial Code Santa Claus; 1989)
  • Girlfriends (1978)
  • I Walk Alone (1947)
  • Jawbreaker (1999)
  • Kitten With a Whip (1964)
  • Lady Snowblood (1973)
  • Lake of Dracula (1971)
  • Last Night at the Alamo (1983)
  • The Last Temptation of Christ (1988)
  • The Man Who Cheated Himself (1950)
  • A Matter of Life and Death (1946)
  • Midnight Express (1978)
  • Out of the Past (1947)
  • Quiet Please, Murder (1942)
  • The Raven (1935)
  • Roadgames (1981)
  • Starstruck (1982)
  • Stranger in Our House (aka Summer of Fear; 1978)
  • Summertime (1955)
  • To Have and Have Not (1944)
  • The Unsuspected (1947)

As far as watching movies outside of a theater, I kind of went down a rabbit hole of Lifetime and Hallmark movies (especially at Christmas), so I didn’t watch as many classic films as I probably should have, and even though I enjoy them, it’s hard to put them in the same class as most movies with higher production values and less predictable plots (but I do thoroughly enjoy the Murder She Baked, Aurora Teagarden, and Jane Doe mystery series, and I thought that Dangerous Child, Evil Nanny, and Killer Body aka The Wrong Patent were among the better ones). Nevertheless, the following were among my favorite first-time watches outside of a theater in 2018:

  • Bachelor Mother (1939)
  • The Cheyenne Social Club (1970)
  • Dark Passage (1947)
  • Father Goose (1964)
  • First Reformed (2017)
  • From Beyond the Grave (1974)
  • Hearts Beat Loud (2018)
  • Psychos in Love (1987)
  • Seven Chances (1925)
  • Too Many Husbands (1940)

Ping Identity Directory Server 7.2.0.0

We have just released the Ping Identity Directory Server version 7.2.0.0, available for download at https://www.pingidentity.com/en/resources/downloads/pingdirectory-downloads.html. This new release offers a lot of new features, some substantial performance improvements, and a number of bug fixes. The release notes provide a pretty comprehensive overview of the changes, but here are some of the highlights:

  • Added a REST API (using JSON over HTTP) for interacting with the server data. Although we already supported the REST-based SCIM protocol, our new REST API is more feature rich, requires less administrative overhead, and isn’t limited by limitations imposed by SCIM compliance. SCIM remains supported.

  • Dramatically improved the logic that the server uses for evaluating complex filters. It now uses a number of additional metrics to make more intelligent decisions about the order in which components should be evaluated to get the biggest bang for the buck.

  • Expanded our support for composite indexes to provide support for ANDs of multiple components (for example, “(&(givenName=?)(sn=?))”). These filters can be comprised entirely of equality components, or they may combine one or more equality components with either a greater-or-equal filter, a less-or-equal filter, a bounded range filter, or a substring filter.

  • When performing a new install, the server is now configured to automatically export data to LDIF every day at 1:05 a.m. These exports will be compressed and encrypted (if encryption is enabled during the setup process), and they will be rate limited to minimize the impact on performance. We have also updated the LDIF export task to support exporting the contents of multiple backends in the same invocation.

  • Added support for a new data recovery log and a new extract-data-recovery-log-changes command-line tool. This can help administrators revert or replay a selected set of changes if the need arises (for example, if a malfunctioning application applies one or more incorrect changes to the server).

  • Added support for delaying the response to a failed bind operation, during which time no other operations will be permitted on the client connection. This can be used as an alternative to account lockout as a means of substantially inhibiting password guessing attacks without the risk of locking out the legitimate user who has the right credentials. It can also be used in conjunction with account lockout if desired.

  • Updated client connection policy support to make it possible to customize the behavior that the server exhibits if a client exceeds a configured maximum number of concurrent requests. Previously, it was only possible to reject requests with a “busy” result. It is now possible to use additional result codes when rejecting those requests, or to terminate the client connection and abandon all of its outstanding requests.

  • Added support for a new “exec” task (and recurring task) that can be used to invoke a specified command on the server system, either as a one-time event or at recurring intervals. There are several safeguards in place to prevent this from unauthorized use: the task must be enabled in the server (it is not by default), the command to be invoked must be contained in a whitelist file (no commands are whitelisted by default), and the user scheduling the task must have a special privilege that permits its use (no users, not even root users, have this privilege by default). We have also added a new schedule-exec-task tool that can make it easier to schedule an exec task.

  • Added support for a new file retention task (and recurring task) that can be used to remove files with names matching a given pattern that are outside of a provided set of retention criteria. The server is configured with instances of this task that can be used to clean up expensive operation dump, lock conflict details, and work queue backlog thread dumps (any files of each type other than the 100 most recent that are over 30 days old will be automatically removed).

  • Added support for new tasks (and recurring tasks) that can be used to force the server to enter and leave lockdown mode. While in lockdown mode, the server reports itself as unavailable to the Directory Proxy Server (and other clients that look at its availability status) and only accepts requests from a restricted set of clients.

  • Added support for a new delay task (and recurring task) that can be used to inject a delay between other tasks. The delay can be for a fixed period of time, can wait until the server is idle (that is, there are no outstanding requests and all worker threads are idle), or until a given set of search criteria matches one or more entries.

  • Added support for a new constructed virtual attribute type that can be used to dynamically construct values for an attribute using a combination of static text and the values of other attributes from the entry.

  • Improved user and group management in the delegated administration web application. Delegated administrators can create users and control group membership for selected users.

  • Added support for encrypting TOTP shared secrets, delivered one-time passwords, password reset tokens, and single-use tokens.

  • Updated the work queue implementation to improve performance and reduce contention under extreme load.

  • Updated the LDAP-accessible changelog backend to add support for searches that include the simple paged results control. This control was previously only available for searches in local DB backends.

  • Improved the server’s rebuild-index performance, especially in environments with encrypted data.

  • Added a new time limit log retention policy to support removing log files older than a specified age.

  • Updated the audit log to support including a number of additional fields, including the server product name, the server instance name, request control OIDs, details of any intermediate client or operation purpose controls in the request, the origin of the operation (whether it was replicated, an internal operation, requested via SCIM, etc.), whether an add operation was an undelete, whether a delete operation was a soft delete, and whether a delete operation was a subtree delete.

  • Improved trace logging for HTTP-based services (e.g., the REST API, SCIM, the consent API, etc.) to make it easier to correlate events across trace logs, HTTP access logs, and general access logs.

  • Updated the server so that the replication database so that it is possible to specify a minimum number of changes to retain. Previously, it was only possible to specify the minimum age for changes to retain.

  • Updated the purge expired data plugin to support deleting expired non-leaf entries. If enabled, the expired entry and all of its subordinate entries will be removed.

  • Added support for additional equality matching rules that may be used for attributes with a JSON object syntax. Previously, the server always used case-sensitive matching for field names and case-insensitive matching for string values. The new matching rules make it possible to configure any combination of case sensitivity for these components.

  • Added the ability to configure multiple instances of the SCIM servlet extension in the server, which allows multiple SCIM service configurations in the same server.

  • Updated the server to prevent the possibility of a persistent search client that is slow to consume results from interfering with other clients and operations in the server.

  • Fixed an in which global sensitive attribute restrictions could be imposed on replicated operations, which could cause some types of replicated changes to be rejected.

  • Fixed an issue that could make it difficult to use third-party tasks created with the Server SDK.

  • Fixed an issue in which the correct size and time limit constraints may not be imposed for search operations processed with an alternate authorization identity.

  • Fixed an issue with the get effective rights request control that could cause it to incorrectly report that an unauthenticated client could have read access to an entry if there were any ACIs making use of the “ldap:///all” bind rule. Note that this only affected the response to a get effective rights request, and the server did not actually expose any data to unauthorized clients.

  • Fixed an issue with the dictionary password validator that could interfere with case-insensitive validation to behave incorrectly if the provided dictionary file contained passwords with uppercase characters.

  • Fixed an issue in servers with an account status notification handler enabled. In some cases, an administrative password reset could cause a notification to be generated on each replica instead of just the server that originally processed the change.

  • Fixed a SCIM issue in which the totalResults value for a paged request could be incorrect if the SCIM resources XML file had multiple base DNs defined.

  • Added support for running on the Oracle and OpenJDK Java implementations, and the garbage-first garbage collector (G1GC) algorithm will be configured by default when installing the server with a Java 11 JVM. Java 8 (Oracle and OpenJDK distributions) remains supported.

  • Added support for the RedHat 7.5, CentOS 7.5, and Ubuntu 18.04 LTS Linux distributions. We also support RedHat 6.6, RedHat 6.8, RedHat 6.9, RedHat 7.4, CentOS 6.9, CentOS 7.4, SUSE Enterprise 11 SP4, SUSE Enterprise 12 SP3, Ubuntu 16.04 LTS, Amazon Linux, Windows Server 2012 R2 and Windows Server 2016. Supported virtualization platforms include VMWare vSphere 6.0, VMWare ESX 6.0, KVM, Amazon EC2, and Microsoft Azure.

UnboundID LDAP SDK for Java 4.0.9

We have just released version 4.0.9 of the UnboundID LDAP SDK for Java. It is available for download from the releases page of our GitHub repository, from the Files page of our SourceForge repository, and from the Maven Central Repository.

The most significant changes included in this release are:

  • Updated the command-line tool framework to allow tools to have descriptions that are comprised of multiple paragraphs.
  • Updated the support for passphrase-based encryption to work around an apparent JVM bug in the support for some MAC algorithms that could cause them to create an incorrect MAC.
  • Updated all existing ArgumentValueValidator instances to implement the Serializable interface. This can help avoid errors when trying to serialize an argument configured with one of those validators.
  • Updated code used to create HashSet, LinkedHashSet, HashMap, LinkedHashMap, and ConcurrentHashMap instances with a known set of elements to use better algorithms for computing the initial capacity for the map to make it less likely to require the map to be dynamically resized.
  • Updated the LDIF change record API to make it possible to obtain a copy of a change record with a given set of controls.
  • Added additional methods for obtaining a normalized string representation of JSON objects and value components. The new methods provide more control over case sensitivity of field names and string values, and over array order.
  • Improved support for running in a JVM with a security manager that prevents setting system properties (which also prevents access to the System.getProperties method because the returned map is mutable).

UnboundID LDAP SDK for Java 4.0.8

We have just released version 4.0.8 of the UnboundID LDAP SDK for Java. It is available for download from the releases page of our GitHub repository (https://github.com/pingidentity/ldapsdk/releases), from the Files page of our SourceForge repository (https://sourceforge.net/projects/ldap-sdk/files/), and from the Maven Central Repository (https://search.maven.org/search?q=g:com.unboundid%20AND%20a:unboundid-ldapsdk&core=gav).

The most significant changes included in this release are:

  • Fixed a bug in the modrate tool that could cause it to use a fixed string instead of a randomly generated one as the value to use in modifications.
  • Fixed an address caching bug in the RoundRobinDNSServerSet class. An inverted comparison could cause it to use cached addresses after they expired, and to cached addresses that weren’t expired.
  • Updated the ldapmodify tool to remove the restriction that prevented using arbitrary controls with an LDAP transaction or the Ping-proprietary multi-update extended operation.
  • Updated a number of locations in the code that caught Throwable so that they re-throw the original Throwable instance (after performing appropriate cleanup) if that instance was an Error or perhaps a RuntimeException.
  • Added a number of JSONObject convenience methods to make it easier to get the value of a specified field as a string, Boolean, number, object, array, or null value.
  • Added a StaticUtils.toArray convenience method that can be useful for converting a collection to an array when the type of element in the collection isn’t known at compile time.
  • Added support for parsing audit log messages generated by the Ping Identity Directory Server for versions 7.1 and later, including generating LDIF change records that can be used to revert change records (if the audit log is configured to record changes in a reversible form).

Ping Identity Directory Server 7.0.1.0

The Ping Identity Directory Server version 7.0.1.0 has been released and is available for download from the Ping Identity website, along with the Directory Proxy Server, Data Synchronization Server, Data Metrics Server, Server SDK, and Delegated User Admin.

The release notes include a summary of the changes included in this release, but the major enhancements include:

  • Updates to the Delegated Admin application, including managing group memberships.
  • The mirror virtual attribute has been updated to make it possible to mirror the values of a specified attribute in another entry whose DN is computed in a manner that is relative to the target entry’s DN.
  • The Directory Proxy Server’s failover load-balancing algorithm has been updated to make it possible to consistently route requests targeting different branches to different sets of servers. This is useful to help distribute load more evenly across servers while still avoiding potential problems due to propagation delay.
  • Added a new replication state detail virtual attribute that provides more detailed information about an entry’s replication state.
  • Improved the server’s behavior when attempts to write to a client are blocked.
  • Added support for unbound GSSAPI connections that are not tied to any specific server instance and work better in some kinds of load-balanced environments.
  • Updated JMX MBean support so that keys and values better conform to best practices by default.

UnboundID LDAP SDK for Java 4.0.7

We have just released the UnboundID LDAP SDK for Java version 4.0.7, available for download from the releases page of our GitHub repository, from the Files page of our SourceForge project, and from the Maven Central Repository. The most significant changes in this release include:

  • Fixed an issue in the LDAPConnectionPool and LDAPThreadLocalConnectionPool classes when created with a connection that is already established and authenticated (as opposed to being created from a server set and bind request). Internally, the LDAP SDK created its own server set and bind request from the provided connection’s state information, but it incorrectly included bind credentials in the server set. Under most circumstances, this would merely cause the LDAP SDK to send two bind requests (the second a duplicate of the first) when establishing a new connection as part of the pool. However, it caused a bigger problem when using the new setBindRequest methods that were introduced in the 4.0.6 release. Because the server set was created with bind credentials, the pool would create a connection that tried to use those old credentials before sending a second bind request with the new credentials, and this would fail if the old credentials were no longer valid.
  • Fixed an issue with the behavior that the LDAP SDK exhibited when configured to automatically follow referrals. If the server returned a search result reference that the LDAP SDK could not follow (for example, because none of the URLs were valid, none of the servers could be reached, none of the searches succeeded, in those servers, etc.), the LDAP SDK would assign a result code of “referral” to the search operation, which would cause it to throw an exception when the search completed (as is the case for most non-success result codes). The LDAP SDK will no longer override the result code for the search operation, but will instead use whatever result code the server returned in its search result done message. Any search result references that the LDAP SDK could not automatically follow will be made available to the caller through the same mechanism that would have been used if the SDK had not been configured to automatically follow referrals (that is, either hand them off to a search result listener or collect them in a list to include in the search result object). The LDAP SDK was already making the unfollowable search result references available in this manner, but the client probably wouldn’t have gotten to the point of looking for them because of the exception resulting from the overridden operation result code.
  • Added a new LDAPConnectionPoolHealthCheck.performPoolMaintenance method that can be used to perform processing on the pool itself (rather than on any individual connection) at regular intervals as specified by the connection pool’s health check interval. This method will be invoked by the health check thread after all other periodic health checking is performed.
  • Added a new PruneUnneededConnectionsLDAPConnectionPoolHealthCheck class that can be used to monitor the size of a connection pool over time, and if the number of available (that is, not currently in use) connections is consistently greater than a specified minimum for a given length of time, then the number of connections in the pool can be reduced to that minimum. This can be used to automatically shrink the size of the pool during periods of reduced activity.
  • Updated the Schema class to provide additional constructors and methods that can be used to attempt to retrieve the schema without silently ignoring errors about unparsable elements. Previously, if a schema entry contained one or more unparsable elements, they would be silently ignored. It is now possible to more easily obtain information about unparsable elements or to have the LDAP SDK throw an exception if it encounters any unparsable elements.
  • Added createSubInitialFilter, createSubAnyFilter, and createSubFinalFilter methods to the Filter class that are more convenient to use than the existing createSubstringFilter methods for substring filters that only have one type of component.
  • Updated the Entry.diff method when operating in reversible mode so that when altering the values of an existing attribute, the delete modifications will be ordered before the add modifications. Previously, the adds came before the deletes, but this could cause problems in some directory servers, especially when the modifications are intended to change the case of a value in a case-insensitive attribute (for example, the add could be ignored or rejected because the value already exists in the entry, or the delete could end up removing the value entirely). Ordering the deletes before the adds should provide much more reliable results.
  • Updated the modrate tool to add a new “--valuePattern” argument that can be used to specify the pattern to use to generate new values. This argument is an alternative to the “--valueLength” and “--characterSet” arguments and allows for more flexibility in the types of values that can be generated.
  • Updated the manage-account tool so that the arguments related to TOTP secrets are marked sensitive. This will ensure that the value is not displayed in the clear in certain cases like interactive mode output or tool invocation logging.
  • Added a new “streamfile” value pattern component that operates like the existing “sequentialfile” component except that it limits the amount of the file that is read into memory at any given time, so it is more suitable for reading values from very large files.
  • Added a new “timestamp” value pattern component that can be used to include either the current time or a randomly selected time from a given range in a variety of formats.
  • Added a new “uuid” value pattern component that can be used to include a randomly generated universally unique identifier (UUID).
  • Added a new “random” value pattern component that can be used to include a specified number of randomly selected characters from a given character set.
  • Added a StaticUtils.toUpperCase method to complement the existing StaticUtils.toLowerCase method.
  • Added Validator.ensureNotNullOrEmpty methods that work for collections, maps, arrays, and character sequences.
  • Added LDAPTestUtils methods that can be used to make assertions about the diagnostic message of an LDAP result or an LDAP exception.
  • Added client-side support for a new exec task that can be used to invoke a specified command in the Ping Identity Directory Server (subject to security restrictions imposed by the server).
  • Added client-side support for a new file retention task that can be used to examine files in a specified directory, identify files matching a given pattern, and delete any of those files that do not match count-based, age-based, or size-based criteria.
  • Added client-side support for a new delay task that can be used sleep for a specified period of time, until the server work queue reports that all worker threads are idle and there are no pending operations, or until a given search or set of searches match at least one entry. The delay task is primarily intended to be used as a spacer between other tasks in a dependency chain.
  • Updated support for the ignore NO-USER-MODIFICATION request control to make it possible to set the criticality when creating an instance of the control. Previously, new instances were always critical.
  • Updated the ldapmodify tool to include the ignore NO-USER-MODIFICATION request control in both add and modify requests if the --ignoreNoUserModification argument was provided. Previously, that argument only caused the control to be included in add requests. Further, the control will now be marked non-critical instead of critical.
  • Updated the task API to add support for a number of new properties, including the email addresses of users to notify on task start and successful completion (in addition to the existing properties specifying users to email on error or on any type of completion), and flags indicating whether the server should alert on task start, successful completion, or failure.
  • Updated the argument parser’s properties file support so that it expects the file to use the ISO 8859-1 encoding, and to support Unicode escape sequences that are comprised of a backslash followed by the letter u and four hexadecimal digits.
  • Updated the tool invocation logger to add a failsafe mechanism for preventing passwords from being included in the log. Although it will already redact the values of any arguments that are declared sensitive, it will now also redact the values of any arguments whose name suggests that their value is a password.

Ping Identity Directory Server 7.0.0.0

We have just released the Ping Identity Directory Server version 7.0.0.0, along with supporting products including the Directory Proxy Server, Data Synchronization Server, and Data Metrics Server. They’re available to download at https://www.pingidentity.com/en/resources/downloads/pingdirectory-downloads.html.

Full release notes are available at https://documentation.pingidentity.com/pingdirectory/7.0/relnotes/, and there are a lot of enhancements, fixes, and performance improvements, but some of the most significant new features are described below.

 

Improved Encryption for Data at Rest

We have always supported TLS to protect data in transit, and we carefully select from the set of available cipher suites to ensure that we only use strong encryption, preferring forward secrecy when it’s available. We also already offered protection for data at rest in the form of whole-entry encryption, encrypted backups and LDIF exports, and encrypted changelog and replication databases. In the 7.0 release, we’re improving upon this encryption for data at rest with several enhancements, including:

  • Previously, if you wanted to enable data encryption, you had to first set up the server without encryption, create an encryption settings definition, copy that definition to all servers in the topology, and export the data to LDIF and re-import it to ensure that any existing data got encrypted. With the 7.0 release, you can easily enable data encryption during the setup process, and you can provide a passphrase to use to generate the encryption key. If you supply the same passphrase when installing all of the instances, then they’ll all use the same encryption key.
  • Previously, if you enabled data encryption, the server would encrypt entries, but indexes and certain other database metadata (for example, information needed to store data compactly) remained unencrypted. In the 7.0 release, if you enable data encryption, we now encrypt index keys and that other metadata so that no potentially sensitive data is stored in the clear.
  • It was already possible to encrypt backups and LDIF exports, but you had to explicitly indicate that they should be encrypted, and the encryption was performed using a key that was shared among servers in the topology but that wasn’t available outside of the topology. In the 7.0 release, we have the option to automatically encrypt backups and LDIF exports, and that’s enabled by default if you configure encryption at setup. You also have more control over the encryption key so that encrypted backups and LDIF exports can be used outside of the topology.
  • We now support encrypted logging. Log-related tools like search-logs, sanitize-log, and summarize-access-log have been updated to support working with encrypted logs, and the UnboundID LDAP SDK for Java has been updated to support programmatically reading and parsing encrypted log files.
  • Several other tools that support reading from and writing to files have also been updated so that they can handle encrypted files. For example, tools that support reading from or writing to LDIF files (ldapsearch, ldapmodify, ldifsearch, ldifmodify, ldif-diff, transform-ldif, validate-ldif) now support encrypted LDIF.

 

Parameterized ACIs

Our server offers a rich access control mechanism that gives you fine-grained control over who has access to what data. You can define access control rules in the configuration, but it’s also possible to store rules in the data, which ensures that they are close to the data they govern and are replicated across all servers in the topology.

In many cases, it’s possible to define a small number of access control rules at the top of the DIT that govern access to all data. But there are other types of deployments (especially multi-tenant directories) where the data is highly branched, and users in one branch should have a certain amount of access to data in their own branch but no access to data in other branches. In the past, the only way to accomplish this was to define access control rules in each of the branches. This was fine from a performance and scalability perspective, but it was a management hassle, especially when creating new branches or if it became necessary to alter the rules for all of those branches.

In the 7.0 release, parameterized ACIs address many of these concerns. Parameterized ACIs make it possible to define a pattern that is automatically interpreted across a set of entries that match the parameterized content.

For example, say your directory has an “ou=Customers,dc=example,dc=com” entry, and each customer organization has its own branch below that entry. Each of those branches might have a common structure (for example, users might be below an “ou=People” subordinate entry, and groups might be below “ou=Groups”). The structure for an Acme organization might look something like:

  • dc=example,dc=com
    • ou=Customers
      • ou=Acme
        • ou=People
          • uid=amanda.adams
          • uid=bradley.baker
          • uid=carol.collins
          • uid=darren.dennings
        • ou=Groups
          • cn=Administrators
          • cn=Password Managers

If you want to create a parameterized ACI so that members of the “ou=Password Managers,ou=Groups,ou={customerName},ou=Customers,dc=example,dc=com” group have write access to the userPassword attribute in entries below “ou=People,ou={customerName},ou=Customers,dc=example,dc=com”, you might create a parameterized ACI that looks something like the following:

(target=”ldap:///ou=People,ou=($1),ou=Customers,dc=example,dc=com”)(targetattr=”userPassword”)(version 3.0; acl “Password Managers can manage passwords”; allow (write) groupdn=”ldap:///cn=Password Managers,ou=Groups,ou=($1),ou=Customers,dc=example,dc=com”;)

 

Recurring Tasks

The Directory Server supports a number of different types of administrative tasks, including:

  • Backing up one or more server backends
  • Restoring a backup
  • Exporting the contents of a backend to LDIF
  • Importing data from LDIF
  • Rebuild the contents of one or more indexes
  • Force a log file rotation

Administrative tasks can be scheduled to start immediately or at a specified time in the future, and you can define dependencies between tasks so that one task won’t be eligible to start until another one completes.

In previous versions, when you scheduled an administrative task, it would only run once. If you wanted to run it again, you needed to schedule it again. In the 7.0 release, we have added support for recurring tasks, which allow you to define a schedule that causes them to be processed on a regular basis. We have some pretty flexible scheduling logic that allows you to specify when they get run, and it’s able to handle things like daylight saving time and months with different numbers of days.

Although you can schedule just about any kind of task as a recurring task, we have enhanced support for backup and LDIF export tasks, since they’re among the most common types of tasks that we expect administrators will want to run on a recurring basis. For example, we have built-in retention support so that you can keep only the most recent backups or LDIF exports (based on either the number of older copies to retain or the age of those copies) so that you don’t have to manually free up disk space.

 

Equality Composite Indexes

The server offers a number of types of indexes that can help you ensure that various types of search operations can be processed as quickly as possible. For example, an equality attribute index maps each of the values for a specified attribute type to a list of the entries that contain that attribute value.

In the 7.0 release, we have introduced a new type of index called a composite index. When you configure a composite index, you need to define at least a filter pattern that describes the kinds of searches that will be indexed, and you can also define a base DN pattern that restricts the index to a specified portion of the DIT.

At present, we only support equality composite indexes, which allow you to index values for a single attribute, much like an equality attribute index. However, there are two key benefits of an equality composite index over an equality attribute index:

  • As previously stated, you can combine the filter pattern with a base DN pattern. This is very useful in directories that have a lot of branches (for example, a multi-tenant deployment) where searches are often constrained to one of those branches. By combining a filter pattern with a base DN pattern, the server can maintain smaller ID sets that are more efficient to process and more tightly scoped to the search being issued.
  • The way in which the server maintains the ID sets in a composite index is much more efficient for keys that match a very large number of entries than the way it maintains the ID set for an attribute index. In an attribute index, you can optimize for either read performance or write performance of a very large ID set, but not both. A composite index is very efficient for both reads and writes of very large ID sets.

In the future, we intend to offer support for additional types of composite indexes that can improve the performance for other types of searches. For example, we’re already working on AND composite indexes that allow you to index combinations of attributes.

 

Delegated Administration

We have added a new delegated administration web application that integrates with the Ping Identity Directory Server and Ping Federate products to allow a selected set of administrators to manage users in the directory. For example, help desk employees might use it to unlock a user’s account or reset their password. Administrators can be restricted to managing only a defined subset of users (based on things like their location in the DIT, entry content, or group membership), and also restricted to a specified set of attributes.

 

Automatic Entry Purging

In the past, our server has had limited support for automatically deleting data after a specified length of time. The LDAP changelog and the replication database can be set to purge old data, and we also support automatically purging soft-deleted entries (entries that have been deleted as far as most clients are concerned, but are really just hidden so that they can be recovered if the need arises).

With the 7.0 release, we’re exposing a new “purge expired data” plugin that can be used to automatically delete entries that match a given set of criteria. At a minimum, this criteria involves looking at a specified attribute or JSON object field whose value represents some kind of timestamp, but it can also be further restricted to entries in a specified portion of the DIT or entries matching a given filter. And it’s got rate limiting built in so that the background purging won’t interfere with client processing.

For example, say that you’ve got an application that generates data that represents some kind of short-lived token. You can create an instance of the purge expired data plugin with a base DN and filter that matches those types of entries, and configure it to delete entries with a createTimestamp value that is more than a specified length of time in the past.

 

Better Control over Unindexed Searches

Despite the variety of indexes defined in the server, there may be cases in which a client issues a search request that the server cannot use indexes to process efficiently. There are a variety of reasons that this may happen, including because there isn’t any applicable index defined in the server, because there so many entries that match the search criteria that the server has stopped maintaining the applicable index, or because the search targets a virtual attribute that doesn’t support efficient searching.

An unindexed search can be very expensive to process because the server needs to iterate across each entry in the scope of the search to determine whether it matches the search criteria. Processing an unindexed search can tie up a worker thread for a significant length of time, so it’s important to ensure that the server only actually processes the unindexed searches that are legitimately authorized. We already required clients to have the unindexed-search privilege, limited the number of unindexed searches that can be active at any given time, and provided an option to disable unindexed searches on a per-client-connection-policy basis.

In the 7.0 release, we’ve added additional features for limiting unindexed searches. They include:

  • We’ve added support for a new “reject unindexed searches” request control that can be included in a search request to indicate that the server should reject the request if it happens to be unindexed, even if would have otherwise been permitted. This is useful for a client that has the unindexed-search privilege but wants a measure of protection against inadvertently requesting an unindexed search.
  • We’ve added support for a new “permit unindexed searches” request control, which can be used in conjunction with a new “unindexed-search-with-control” privilege. If a client has this privilege, then only unindexed search requests that include this the permit unindexed searches control will be allowed.
  • We’ve updated the client connection policy configuration to make it possible to only allow unindexed searches that include the permit unindexed searches request control, even if the requester has the unindexed-search privilege.

 

GSSAPI Improvements

The GSSAPI SASL mechanism can be used to authenticate to the Directory Server using Kerberos V. We’ve always supported this mechanism, but the 7.0 server adds a couple of improvements to that support.

First, it’s now possible for the client to request an authorization identity that is different from the authentication identity. In the past, it was only possible to use GSSAPI if the authentication identity string exactly matched the authorization identity. Now, the server will permit the authorization identity to be different from the authentication identity (although the user specified as the authentication identity must have the proxied-auth privilege if they want to be able to use a different authorization identity).

We’ve also improved support for using GSSAPI through hardware load balancer, particularly in cases where the server uses a different FQDN than was used in the client request. This generally wasn’t an issue for the case in which a Ping Identity Directory Proxy Server was used to perform the load balancing, but it could have been a problem in some cases with hardware load balancers or other cases in which the client might connect to the server with a different name than the server thinks it’s using.

 

Tool Invocation Logging

We’ve updated our tool frameworks to add support for tool invocation logging, which can be used to record the arguments and result for any command-line tools provided with the server. By default, this feature is only enabled for tools that are likely to change the state of the server or the data contained in the server, and by default, all of those tools will use the same log file. However, you can configure which (if any) tools should be logged, and which files should be used.

Invocation logging includes two types of log messages:

  • A launch log message, which is recorded whenever the tool is first run but before it performs its actual processing. The launch log message includes the name of the tool, any arguments provided on the command line, any arguments automatically supplied from a properties file, the time the tool was run, and the username for the operating system account that ran the tool. The values of any sensitive arguments (for example, those that might be used to supply passwords) will be redacted so that information will not be recorded in the log.
  • A completion log message, which is recorded whenever the tool completes its processing, regardless of whether it completed successfully or exited with an error. This will at least include the tool’s numeric exit code, but in some cases, it might also include an exit message with additional information about the processing performed by the tool. Note that there may be some circumstances in which the completion log message may not be recorded (for example, if the tool is forcefully terminated with something like a “kill -9”).

UnboundID LDAP SDK for Java 4.0.6

We have just released the UnboundID LDAP SDK for Java version 4.0.6, available for download from the releases page of our GitHub repository, from the Files page of our SourceForge project, and from the Maven Central Repository. The most significant changes in this release include:

  • We fixed a number of issues in the way that the LDAP SDK handled characters whose UTF-8 representation requires more than two bytes (and therefore requires two Java chars to represent a single character). Issues related to these characters were found in code for matching rules, DNs and RDNs, and search filters.
  • We fixed an issue in the ldapsearch tool that could cause it to use an incorrect scope when constructing search requests from LDAP URLs that were read from a file.
  • We fixed a bug in schema handling that could arise if an object class definition did not explicitly specify an object class type (STRUCTURAL, AUXILIARY, or ABSTRACT). In some cases, the type could be incorrectly inherited from the superclass rather than assuming the default type of STRUCTURAL.
  • We updated the LDAPConnectionPool and LDAPThreadLocalConnectionPool classes to add new setServerSet and setBindRequest methods. These new methods make it possible to update an existing pool to change the logic that it uses for establishing and authenticating new connections.
  • We added a new LDAPRequest.setReferralConnector method that makes it possible to set a custom referral connector on a per-request basis. We also added a new RetainConnectExceptionReferralConnector class that makes it easier to obtain the exception (if any) that was caught on the last attempt to establish a connection for the purpose of following a referral.
  • Updated the in-memory directory server to better handle any java.lang.Errors that occur while interacting with a client connection. These kinds of errors should not happen under normal circumstances but may be generated by third-party code (for example, an InMemoryOperationInterceptor), and it is possible for the JVM to generate them in extraordinary circumstances like running out of memory. In such cases, the thread responsible for interacting with that client would exit without returning a response for the operation being processed and without closing the operation. The LDAP SDK will now attempt to return an error (if appropriate for the type of operation being processed) and close the connection.
  • Updated the manage-certificates tool to fix an incorrect interpretation of the path length element of a basic constraints extension.
  • Updated manage-certificates to add support for importing PEM-encoded RSA private keys that are not wrapped in a PKCS #8 envelope (that is, from a file whose header contains “BEGIN RSA PRIVATE KEY” instead of “BEGIN PRIVATE KEY”). Previously, it was only possible to import private keys using the PKCS #8 format.
  • Updated manage-certificates to add an --allow-sha-1-signature-for-issuer-certificates argument to the check-certificate-usability subcommand. If this argument is provided, then the tool will continue to call out issuer certificates whose signature is based on the now-considered-weak SHA-1 digest algorithm, but it will no longer cause the tool to exit with an error just because of that issue. This argument has no effect for certificates that use a signature based on the extremely weak MD5 digest, and it also does not have any effect if the certificate at the head of the chain (that is, the server certificate rather than the root certificate) has a SHA-1-based signature.
  • Added client-side support for a new “reload HTTP connection handler certificates” task that may be used in some Ping Identity server products to request that the server dynamically reload the certificate key and trust stores used by all HTTP connection handler instances that provide support for HTTPS.

CVE-2018-1000134 and the UnboundID LDAP SDK for Java

On Friday, March 16, 2018, CVE-2018-1000134 was published, describing a vulnerability in the UnboundID LDAP SDK for Java. The vulnerability has been fixed in LDAP SDK version 4.0.5, which is available for immediate download from the LDAP.com website, from the releases page of our GitHub repository, from the Files page of our SourceForge project, and from the Maven Central Repository.

This post will explain the issue in detail (see the release notes for information about other changes in LDAP SDK version 4.0.5). However, to quickly determine whether your application is vulnerable, you should check to see if all of the following conditions are true:

  • You are using the LDAP SDK in synchronous mode. Although this mode is recommended for applications that do not require asynchronous functionality, the LDAP SDK does not use this mode by default.
  • You use the LDAP SDK to perform simple bind operations for the purpose of authenticating users to a directory server. This is a very common use case for LDAP-enabled applications.
  • Your application does not attempt to verify whether the user actually provided a password. This is unfortunately all too common for LDAP-enabled applications.
  • The simple bind requests are sent to a directory server that does not follow the RFC 4513 section 5.1.2 recommendation to reject simple bind requests with a non-empty DN and an empty password. Although this recommendation is part of the revised LDAPv3 specification published in 2006, there are apparently some directory servers that still do not follow this recommendation by default.

If your application meets all of these criteria, then you should take action immediately to protect yourself. The simplest way to fix the vulnerability in your application is to update it to use the 4.0.5 release of the LDAP SDK. However, you should also ensure that your applications properly validate all user input, and it may also be a good idea to consider switching to a more modern directory server.

The Vulnerability in LDAPv3

The original LDAPv3 protocol specification was published as RFC 2251 in December 1997. LDAPv3 is a very impressive protocol in most regards, but perhaps the most glaring problem in the specification lies in the following paragraph in section 4.2.2:

If no authentication is to be performed, then the simple authentication option MUST be chosen, and the password be of zero length. (This is often done by LDAPv2 clients.) Typically the DN is also of zero length.

It’s that word “typically” in this last sentence that has been the source of a great many vulnerabilities in LDAP-enabled applications. Usually, when you want to perform an anonymous simple bind, you provide an empty string for both the DN and the password. However, according to the letter of the specification above, you don’t have to provide an empty DN. As long as the password is empty, the server will treat it as an anonymous simple bind.

In applications that use an LDAP simple bind to authenticate users, it’s a very common practice to provide two fields on the login form: one for the username (or email address or phone number or some other kind of identifier), and one for the password. The application first performs a search to see if they can map that username to exactly one user in the directory, and if so, then it performs a simple bind with the DN of that user’s entry and the provided password. As long as that the server returns a “success” response to the bind request, then the application considers the user authenticated and will grant them whatever access that user is supposed to have.

However, a problem can arise if the application just blindly takes whatever password was provided in the login form and plugs it into the simple bind request without actually checking to see whether the user provided any password at all. In such cases, if the user provided a valid username but an empty password, then the application will perform a simple bind request with a valid DN but no password. The directory server will interpret that as an anonymous simple bind and will return a success result, and the application will assume that the user is authenticated even though they didn’t actually provide any password at all.

This is such a big problem in LDAP-enabled applications that it was specifically addressed in the updated LDAPv3 specification published in June 2006. RFC 4513 section 5.1.2 states the following:

Unauthenticated Bind operations can have significant security issues (see Section 6.3.1). In particular, users intending to perform Name/Password authentication may inadvertently provide an empty password and thus cause poorly implemented clients to request Unauthenticated access. Clients SHOULD be implemented to require user selection of the Unauthenticated Authentication Mechanism by means other than user input of an empty password. Clients SHOULD disallow an empty password input to a Name/Password Authentication user interface. Additionally, Servers SHOULD by default fail Unauthenticated Bind requests with a resultCode of unwillingToPerform.

Further, section 6.3.1 of the same RFC states:

Operational experience shows that clients can (and frequently do) misuse the unauthenticated access mechanism of the simple Bind method (see Section 5.1.2). For example, a client program might make a decision to grant access to non-directory information on the basis of successfully completing a Bind operation. LDAP server implementations may return a success response to an unauthenticated Bind request. This may erroneously leave the client with the impression that the server has successfully authenticated the identity represented by the distinguished name when in reality, an anonymous authorization state has been established. Clients that use the results from a simple Bind operation to make authorization decisions should actively detect unauthenticated Bind requests (by verifying that the supplied password is not empty) and react appropriately.

In directory servers that follow the recommendation from RFC 4513 section 5.1.2, clients can perform an anonymous simple bind by providing an empty DN and an empty password, but an attempt to bind with a non-empty DN and an empty password will be rejected. This very good recommendation was made over ten years ago, and the code change needed to implement it is probably very simple. However, for some reason, there are directory server implementations out there that haven’t been updated to follow this recommendation, and therefore leave client applications open to this inadvertent vulnerability.

The Vulnerability in the UnboundID LDAP SDK for Java

Ever since its initial release, the UnboundID LDAP SDK for Java has attempted to protect against simple bind requests that include a non-empty DN with an empty password. The LDAPConnectionOptions class provides a setBindWithDNRequiresPassword(boolean) method that you can use to indicate whether the LDAP SDK will reject a simple bind request that has a non-empty DN with an empty password. If you don’t explicitly use this option, then the LDAP SDK will assume a default value of true. If you try to send a simple bind request that includes a non-empty DN and an empty password, then the LDAP SDK won’t actually send any request to the server but will instead throw an LDAPException with a result code of ResultCode.PARAM_ERROR and a message of “Simple bind operations are not allowed to contain a bind DN without a password.”

Or at least, that’s the intended behavior. And that is the behavior that you’ll get if you send the bind request in the asynchronous mode that the LDAP SDK uses by default. However, Stanis Shkel created GitHub issue #40 (“processSync in SimpleBindRequest allows empty password with set bindDN”), which points out that this check was skipped for connections operating in synchronous mode.

LDAP is an asynchronous protocol. With a few exceptions, it’s possible to have multiple operations in progress simultaneously over the same LDAP connection. To support that asynchronous capability, the LDAP SDK maintains an extra background thread that constantly read data from a connection and makes sure that any data sent from the server gets delivered to whichever thread is waiting for it. This is just fine most of the time, but it does come at the cost of increased resource consumption, and a small performance hit from handing off data from one thread to another. To minimize this impact for applications that don’t take advantage of the asynchronous capabilities that LDAP provides, we added a synchronous mode to the LDAP SDK way back in version 0.9.10 (released in July of 2009). In this mode, the same thread that sends a request to the server is the one that waits for and reads the response. This can provide better performance and lower resource consumption, but you have to explicitly enable it using the LDAPConnectionOptions.setUseSynchronousMode(boolean) method before establishing a connection.

In the course of implementing support for the synchronous mode for a simple bind request, we incorrectly put the check for synchronous mode before the check for an empty password. For a connection operating in synchronous mode, we branched off to another part of the code and skipped the check for an empty password. The fix for the problem was simple: move the check for an empty password above the check for synchronous mode, and it was committed about three and a half hours after the issue was reported, including a unit test to ensure that a simple bind request with a non-empty DN and an empty password is properly rejected when operating in synchronous mode (there was already a test to ensure the correct behavior in the default asynchronous mode).

Conditions Necessary for the Vulnerability

Although there was unquestionably a bug in the LDAP SDK that created the possibility for this bug, there are a number of factors that could have prevented an application from being susceptible to it. Only an application that meets all of the following conditions would have been vulnerable:

  • The application must have explicitly enabled the use of synchronous mode when creating an LDAP connection or connection pool. If the application was using the default asynchronous mode, it would not have been vulnerable.
  • The application must have created simple bind requests from untrusted and unverified user input. If the application did not create simple bind requests (for example, because it did not perform binds at all, or because it used SASL authentication instead of simple), then it would not have been vulnerable. Alternately, if the application validated the user input to ensure that it would not attempt to bind with an empty password, then it would not have been vulnerable.
  • The application must have sent the simple bind request to a server that does not follow the RFC 4513 recommendations. If the server is configured to reject simple bind requests that contain a non-empty DN with an empty password, then an application communicating with that server would not have been vulnerable.

While we strongly recommend updating to LDAP SDK version 4.0.5, which no longer has the bug described in CVE-2018-1000134, we also strongly recommend ensuring that applications properly validate all user input as additional mitigation against problems like this. And if you’re using a directory server that hasn’t been updated to apply a very simple update to avoid a problem that has been well known and clearly documented for well over a decade, then perhaps you should consider updating to a directory server that takes security and standards compliance more seriously.

Movies Watched Theatrically in January 2018

Molly’s Game (2017; first-time watch) — After her hopes of being an Olympic skier are dashed, Molly Bloom (Jessica Chastain) finds herself running regular high-stakes poker games with celebrities, the rich, and the powerful. And when she’s busted by the FBI, she convinces a top attorney (Idris Elba) to defend her. Written and directed by Aaron Sorkin, it feels like a lesser effort from him, with much less snappy dialogue than I would have expected, and many elements recycled from his earlier work. Adequate, but disappointing.

Bombshell: The Hedy Lamarr Story (2017; first-time watch) — This documentary tells the largely tragic story of a woman with the odds often stacked against her. As a promising and beautiful young actress, she had to overcome the stigma of appearing in films that were too racy for her time and a string of failed marriages, but she also was saddled with an image of a dumb beauty despite conceiving an idea that became a foundation of modern wireless network communication. While it has interesting content, the film does feel a little superficial and repetitive at times.

Downsizing (2017; first-time watch) — Scientists have come up with a way to shrink humans to a height of just a couple of inches. Paul (Matt Damon) and his wife Audrey (Kristen Wiig) have decided to do go through the procedure because it will allow them to live more extravagant lives, but Audrey backs out at the last minute after Paul has already downsized. She also puts him through a costly divorce, leaving him alone and broke. It’s an interesting premise, but then the film undergoes several major shifts that are increasingly dumb and boring.

Idiocracy (2006; rewatch) — Joe (Luke Wilson) and Rita (Maya Rudolph) are subjects in a human hibernation experiment that is expected to last a year, but they wake up 500 years later to a much different world. Civilization has declined so severely that they are now the most intelligent people in the world and humanity is on the brink of destruction. As a comedy, it’s very funny, but its prediction of a potential future feels like it’s turning out to be too close for comfort.

The Shape of Water (2017; first-time watch) — A secret government facility has captured an amphibious humanoid and is subjecting it to a lot of testing (performed by characters played by Michael Shannon and Michael Stuhlbarg) in the hopes that it will help unlock secrets to help the United States beat Russia in the space race. But a mute cleaning woman (Sally Hawkins) develops a special bond with the creature, and she enlists the help of her best friends (Octavia Spencer and Richard Jenkins) to hatch a plan to free it. It feels much less like a del Toro film than most of his other movies, which may be a contributing factor to me liking it a lot more than most of his other movies.

Barking Dogs Never Bite (2000; rewatch) — A graduate student hopes to become a professor, but his studies are hindered by a dog that won’t stop yapping somewhere in his apartment complex. He finds a dog and takes care of the problem, only to learn that it wasn’t the responsible animal and now he’s got the same problems plus a guilty conscience. From there, things go downhill in this very funny first film from Bong Joon-ho that features Bae Doo-na in one of her earliest roles.

Beggars of Life (1928; first-time watch) — Hoping to exchange work for breakfast, a hobo (Richard Arlen) walks into a house with an open door and discovers a dead man at the breakfast table. He then sees the man’s daughter (Louise Brooks) and learns that she killed him in self-defense while he was trying to get too familiar with her. The hobo takes pity on her and agrees to help her escape to Canada. In an attempt to avoid drawing attention to themselves, she disguises herself as a boy, but the ruse doesn’t hold up, and now she faces more of the same harassment from several other hobos. It’s great until the end, where it loses some momentum and leaves you walking out of the theater with a hint of disappointment.

I Don’t Feel at Home in This World Anymore (2017; first-time watch) — Ruth (Melanie Lynskey) is in a funk because the world is full of assholes and she’s had a run of bad luck. To top it all off, her house has been robbed, and the police are clearly not interested in finding out who did it. With the help of Tony (Elijah Wood), a weird neighbor who’s into God and martial arts, she does her own investigating and soon finds herself just getting deeper into trouble. It’s much funnier than its title would suggest, and a great first directorial effort from Macon Blair.

The Other Side of Hope (2017; first-time watch) — A Syrian refugee arrives in Finland after stowing away on a ship and decides to seek political asylum. Meanwhile, a salesman decides to try his hand at running a restaurant. Their paths cross, and they find themselves facing significant obstacles. An anticipated film from Aki Kaurismäki, the acting is good, but the story is a little flat, and it takes too long for the storylines to meet.

Deadfall (1993; rewatch) — Joe (Michael Biehn) is a con man who just lost his father Mike (James Coburn) on a job gone wrong. He learns that his father had a twin brother Lou (also Coburn) and decides to seek him out. Lou is also a con man with a plan for a big score, and Joe wants in, much to the dismay of Lou’s right-hand man Eddie (Nicolas Cage). It’s a terrible movie, but Cage’s performance is so enthusiastic and unusual that it may be worth watching just for that (although you’d probably be better off just searching for a supercut video).

I, Tonya (2017; first-time watch) — Tonya Harding (Margot Robbie) is an ice skater and Olympic hopeful, but her white trash background is hurting her both in the scores from judges and in the beatings from her husband Jeff Gillooly (Sebastian Stan). Purportedly unbeknownst to her, Jeff arranges for Nancy Kerrigan (Caitlin Carver), America’s leading female skater, to be clubbed in the knee in the hopes of keeping her out of the competition and ensuring Tonya a spot. It’s a frustrating movie that’s based on a true story but refuses to take a side in any particular version of the truth. Margot Robbie and especially Allison Janney (as Harding’s mother, LaVona) give good performances, but the movie as a whole is just mediocre.

Brimstone & Glory (2017; first-time watch) — Tultepec, Mexico is known for its fireworks. It has many fireworks factories, and they put on an impressive multi-day display during the annual San Juan de Dios festival. However, Mexico does not have the safety standards that America has, and it seems that the people of Tultepec are all complete morons because this documentary shows such ludicrous acts of stupidity as climbing a tower loaded with fireworks that have just been set off by a lightning strike and shooting off fireworks into crowds. While the film is often pretty to look at, it also demonstrates a level of stupid and careless that I just can’t get behind.

Memories of Murder (2003; rewatch) — A bunch of bumbling detectives in rural South Korea are joined by an investigator from Seoul to investigate a series of rapes and murders that seem to happen whenever it rains. Directed by Bong Joon-ho and starring Song Kang-ho, it’s a darkly terrific crime drama laced with the typical incompetent police comedy that so often frequents South Korean film.

Midnight Express (1978; first-time watch) — Billy Hayes (Brad Davis) is about to leave Turkey with his girlfriend Susan (Irene Miracle), but he gets busted at the airport with a couple of kilos of hashish strapped to his body. He’s given a harsh four-year sentence in a prison with other inmates that include John Hurt and Randy Quaid, and that is ruled by a torturous guard (Paul Smith). Hopeful that his father (Mike Kellin), lawyer, and the American ambassador will be able to reduce his sentence, Billy bides his time and tries to be an ideal inmate. But when the Turkish appeals court decides to increase the charge to trafficking and the sentence to life in prison, he decides that he needs to find his own way out. It’s a very dark film that I enjoyed a whole lot.

Scott Pilgrim vs. the World (2010; rewatch) — 22-year-old Scott Pilgrim (Michael Cera) is in a band with Stephen Stills (Mark Webber), Kim Pine (Alison Pill), and “Young” Neil Nordegraf (Johnny Simmons). He was brutally dumped over a year ago by his girlfriend Natalie “Envy” Adams (Brie Larson) and has just entered a new stage of his recovery by starting to date Knives Chau (Ellen Wong), a 17-year-old Chinese Catholic schoolgirl. But then he falls in love with Ramona Flowers (Mary Elizabeth Winstead), only to learn that if they are to date, he must fight and defeat her seven evil exes. Also featuring Kieran Culkin, Chris Evans, Brandon Routh, Jason Schwartzman, Anna Kendrick, and Aubrey Plaza, it is perhaps the best film representation of a graphic novel loaded with video game elements, not to mention an incredible movie with great comedy and an amazing soundtrack, and it remains one of my favorite movies.

The Post (2017; first-time watch) — When the New York Times runs a story exposing over a decade of presidents lying to the American people about Vietnam, the struggling Washington post rushes to get in on the action. Unfortunately, the Times has been sued for the government for printing information from classified documents, and Post owner Kay Graham (Meryl Streep) must balance her desire to pursue the story (including great pressure from editor-in-chief Ben Bradlee, played by Tom Hanks, as well as reporters including those played by Bob Odenkirk, David Cross, Carrie Coon, and Pat Healy) with the pressure of turning the paper into a publicly-traded company, including a very nervous legal team and set of investors. It ends where All the President’s Men begins, but it tells a very different story with a very different focus. It’s a good film loaded with stars (also including Bradley Whitford, Bruce Greenwood, Sarah Paulson, Tracy Letts, Alison Brie, and Jesse Plemons), if a bit heavy-handed at times and clearly fishing for awards.

The Commuter (2018; first-time watch) — Michael (Liam Neeson) is approached by a mysterious woman (Vera Farmiga) who tells him that she wants his help in finding someone who is supposed to be taking the commuter train that he’s been riding for years. If he helps, he’ll get a lot of money. If he doesn’t, his family will be murdered. It’s basically Cellular on a train, and it sucks. It depends heavily on making obviously stupid choices, and none of the “surprises” are actually surprising.

Proud Mary (2018; first-time watch) — Mary (Taraji P. Henson) is an assassin. A year ago, she took out a father but left the son Danny (Jahi Di’Allo Winston) alive, and she’s been secretly following and watching over him out of a sense of guilt. When Danny turns to a life of crime and is beaten up by his boss, Mary intervenes, takes out the boss, and takes Danny into her apartment. But Danny’s boss was one of the higher-ups in the local mafia and a competitor to Mary’s boss Benny (Danny Glover). Amid fears that a war will break out between the two rival organizations, Mary just wants out and to get Danny safe. It’s a story that we’ve seen before, but it’s usually entertaining enough and the action scenes are directed well. Unfortunately, the ending is very weak and Danny Glover continues his streak of terrible acting.

Paddington 2 (2017; first-time watch) — Paddington’s aunt is about to turn 100 years old, and Paddington wants to get her the perfect gift. She had always dreamed of coming to London but never got the chance, so when he stumbles across a one-of-a-kind pop-up book that shows off the city, he wants to get it for her. The only trouble is, it’s very expensive so he’ll have to work to earn the money to buy it. But just before he reaches his goal, the book is stolen, and Paddington is framed for the robbery. It’s almost hard to believe how great this movie is. It’s a totally enthralling plot loaded with jokes and intelligent references, and it’s expertly executed by an amazing cast that includes Sally Hawkins, Hugh Grant, Jim Broadbent, Brendan Gleeson, Hugh Bonneville, Peter Capaldi, Imelda Staunton, Michael Gambon, Jessica Hynes, Noah Taylor, Joanna Lumley, and others.

Darkest Hour (2017; first-time watch) — While Hitler continues to overtake Europe, Neville Chamberlain (Ronald Pickup) is ousted as Prime Minister of Great Britain, and Winston Churchill (Gary Oldman) is in. Britain’s troops are in grave danger of being overtaken, and Churchill’s advisors are urging him to enter into peace talks with Germany, but he refuses to consider it despite their chances looking ever more bleak. It’s a well-acted film that provides a clearer depiction of the events and context than Dunkirk, even if the two movies have very different focuses, and the makeup job used to transform Oldman into Churchill is one of the most impressive of all time.

The Apple (1980; rewatch) — In the future, a giant music publisher called BIM rules the world. Alphie (George Gilmour) and Bibi (Catherine Mary Stewart) want to make it as musicians, but the head of BIM, Mr. Boogalow (Vladek Sheybal), has some pretty steep terms. Bibi agrees to them and becomes a star. Alphie rejects them and struggles. It’s a very clumsy and un-subtle religious allegory full of repetitive and suggestive music that is terrible and incomprehensible, but also pretty fascinating.

Days of Heaven (1978; first-time watch) — After he accidentally kills someone, Bill (Richard Gere) flees with his girlfriend Abbey (Brooke Adams) and his little sister Linda (Linda Manz) to become migrant workers. For some reason, Bill and Abbey decide to pretend to be brother and sister, and the farmer (Sam Shepard) takes a liking to Abbey. Seeing an opportunity to get rich, they decide to try to use that to their financial advantage. The film has about 20 minutes of content spread out over 94 minutes, making Days of Heaven boring as hell.

Princess Cyd (2017; first-time watch) — 16-year-old Cydney (Jessie Pinnick) and her dad have been fighting a lot lately, and he decides it might be a good idea for her to visit her aunt (his late wife’s sister) Miranda (Rebecca Spence). Miranda is a fairly well-known author without much experience taking care of a teenager, but they make a go of it. Meanwhile, Cyd meets Katie (Malic White), and it’s love at first sight. The film is so wonderfully, effortlessly charming, with terrific characters and an oddly subtle obviousness to it that allows it to make all of its points without feeling clumsy or heavy-handed.

There Will Be Blood (2007; rewatch) — Daniel Plainview (Daniel Day-Lewis) is an oil prospector whose relentless drive makes him a very wealthy baron, but at the expense of his personal relationships, including one with his adopted son, and a persistently bothersome evangelist (Paul Dano). It’s got good performances, and I suppose that it’s good, but it’s also terribly long, so it’s a good thing that this screening was cut down to 90 minutes, and that version was expertly mocked by Austin’s Master Pancake Theater comedy troupe.

Small Soldiers (1998; rewatch) — A small toy company is bought by a mega-corporation that includes a military research division. The toy designers (David Cross and Jay Mohr) are instructed to make army men who are supposed to fight aliens, but they use superpowered military chips that make the toys self-aware and go haywire. At first, young Alan (Gregory Smith) is the only one to notice, but soon his neighbor Christy (Kirsten Dunst) also becomes aware. By the time their parents (including Phil Hartman, Wendy Schaal, Kevin Dunn, and Ann Magnuson) learn the truth, they’re already in serious trouble. Directed by Joe Dante, it’s much like Gremlins in that it might appear to be for kids on the surface but is probably really more suitable for an older audience. And while it’s not nearly as good as Gremlins, Small Soldiers is still a well-made film that’s pretty fun to watch.

Coming Home (1978; first-time watch) — When her husband Bob (Bruce Dern) goes off to fight in Vietnam, Sally (Jane Fonda) decides to volunteer at a hospital on the military base. She runs into Luke (Jon Voight), who went to the same high school as she did, and who had been paralyzed in the war. Although Luke is initially very mad at the world, Sally manages to calm him down, and they become good friends, and then more. It’s not surprising that Hal Ashby can so expertly craft a film like this, with a clear message that doesn’t feel pushed down your throat, but it is surprising that he could pull off what feels like a pretty low-budget film and yet still include tons of iconic music from the time from giant groups like The Beatles and The Rolling Stones.

Call Me by Your Name (2017; first-time watch) — Oliver (Armie Hammer) is an American graduate student who has gone to Italy to work for a professor (Michael Stuhlbarg). The professor has a 17-year-old son, Elio (Timothée Chalamet), who is initially intrigued, and then infatuated with, Oliver. While the movie is executed well, it’s also full of boredom and pretension, and it feels like everyone is trying to put on an air of sophisticated enlightenment that makes a lot of the content feel fake.

Phantom Thread (2017; first-time watch) — Reynolds (Daniel Day-Lewis) is a renowned fashion designer who is very full of himself and largely hostile to pretty much everyone else. His sister Cyril (Lesley Manville) is his right-hand man who tries to keep everyone else in line, but she often gets fed up with him. When he tires of one assistant/model/lover, Cyril suggests that he go find another, and that’s when he comes across Alma (Vicky Krieps). They have a fling that leads to her becoming his new model/assistant/muse, and she’s determined to not allow him to cut her out. It’s a surprisingly non-boring film for a fashion-themed period piece, and the ending is really what sealed the deal for me.

The Last of the Mohicans (1992; first-time watch) — Hawkeye (Daniel Day-Lewis) is a white man who was adopted as an orphaned baby by a Mohican family and raised as a member of the tribe. It’s pre-revolution America, when the British are squaring off against the French and the colonists are being pressed into service. Somehow, Hawkeye and his Mohican father and brother find themselves trying to help a pair of British sisters make it through the fighting to their father in a fort. It’s hard to think of any good movie that focuses on America in the revolutionary/pre-revolutionary period, and this certainly isn’t one of them.

The Curse of the Crying Woman (1963; first-time watch) — A woman has inherited a house, but the only problem is that it, and the woods surrounding it, are haunted and deadly to anyone who enters. One of the haunters is a so-called crying woman, whose howls can be heard every night. It’s a short and simple Mexican horror film (dubbed into English by K. Gordon Murray), but surprisingly good.

The Robot vs. the Aztec Mummy (1958; first-time watch) — Through the help of hypnosis, a doctor learns that his wife is the reincarnation of an Aztec princess, and she’s able to guide them to the tomb. That tomb is guarded by a mummy, who will relentlessly pursue any who attempt to disturb anything inside. A mad scientist wants to rob the grave, so he builds a robot to fight the mummy. It’s just over an hour long, with no hint of a robot for over 50 minutes (and much of the content repurposed from an earlier movie in the series), but the lack of quality is more than atoned for by its schlocky enjoyability.

Mom and Dad (2017; rewatch) — Kendall (Selma Blair) tries to be the perfect stay-at-home mom, but she’s frustrated by her husband Brent’s (Nicolas Cage) mid-life crisis, her teenage daughter Carly’s (Anne Winters) rebellion, and her young son Josh’s (Zackary Arthur) typical boyish curiosity and way of finding trouble. And then the world seems to be hit by some mysterious force in which parents get an uncontrollable urge to kill their own children (although not those of anyone else). Things get crazy, and Cage does what he does best in an insignificant but highly enjoyable horror comedy.

Robinson Crusoe on Mars (1964; first-time watch) — Commander Kit Draper (Paul Mantee) and Colonel Dan McReady (Adam West) are orbiting Mars when their attempt to dodge an incoming meteor causes them to crash into the planet. Draper survives, along with his monkey, but McReady does not, and now Draper is forced to deal with a limited supply of food, water, and oxygen, and no ability to communicate back to Earth. It’s like The Martian fifty years before The Martian, with less science but a pretty entertaining storyline.

Mother (2009; rewatch) — Do-joon is an adult with the mental faculties of a young child. He’s always getting into trouble, and his mother is always having to bail him out. When police find evidence that puts Do-joon at a murder scene, they just want to close the case as quickly as possible, so it’s up to his mother to prove that he’s innocent. While not quite as good as Memories of Murder, it is nonetheless another very solid crime drama from master Korean filmmaker Bong Joon-ho.

To Have and Have Not (1944; first-time watch) — Harry Morgan (Humphrey Bogart) is the captain of a fishing boat on the Caribbean island of Martinique, along with his drunken sidekick Eddie (Walter Brennan). The island is under French control, but there’s a resistance building, and Morgan is approached about using his boat to help transport key members of that resistance onto the island. He wants to stay out of it and entertain the very attractive new arrival Marie (Lauren Bacall), but circumstances beg to differ, and he finds himself being targeted by the police. It’s got a lot in common with Casablanca, not the least of which is that it’s an excellent film.

On the Beach at Night Alone (2017; first-time watch) — A former actress goes on vacation in Germany for a while, and then she returns home and meets up with some people. There’s really not much more to it than that, and it is a completely boring film with virtually no plot and even less talent on either side of the camera. It’s presented entirely in master shots with only the occasional clunky pan or zoom (which always seems to result in watching someone have a conversation with someone off screen). There’s not even a scene on the beach at night alone. It’s just pure garbage.

Blow-Up (1966; first-time watch) — Thomas (David Hemmings) is a photographer with a giant ego and little regard for others. While trying to covertly take pictures of a couple in a park, the woman (Vanessa Redgrave) asks him to stop and then is insistent on getting the film. He becomes intrigued with finding out what he might have captured and discovers something in his photos that becomes an obsession. It may take a while to get over Thomas’s grating personality, but it ultimately becomes a very good film on the level with other movies I’d rather not mention to avoid any potential spoilers.

Only the Young (2012; rewatch) — It’s a simple documentary that follows the lives of three Southern California teenagers: Garrison, Kevin, and Skye. It’s got a laid-back feel that seems to capture a lot of honest interaction, intercut with occasional sequences of confiding to the camera. I’d seen it once before and was a little put off by some of the obviously bad decisions on display, but it seems to have more to offer when revisiting it after a few years.

Sullivan’s Travels (1941; rewatch) — John Sullivan (Joel McCrea) is a director who wants to break out of comedy and do a drama about the hardships of the less fortunate. Believing that he can’t really make such a movie without experiencing that kind of life, he tries to forego his Hollywood luxury and spend some time as a hobo. Things don’t go as well as planned, but he does meet a girl (Veronica Lake) who has failed in her shot at becoming an actress and decides to accompany him. It’s a Preston Sturges film, so of course it’s amazing, but it does feel a little more clumsy in areas than some of his other A-plus comedies like The Lady Eve, The Palm Beach Story, and The Miracle of Morgan’s Creek.

Dark Night of the Scarecrow (1981; rewatch) — Bubba (Larry Drake) is an adult with the mental faculties of a young child. Some of the townspeople, including mailman Otis Hazelrigg (Charles Durning), farmer Harless Hocker (Lane Smith), grain dealer Philby (Claude Earl Jones), and mechanic Skeeter (Robert F. Lyons), think that he’s a danger to the children, and when a girl (Tonya Crowe) gets hurt while playing with him, they jump at the chance to make sure he never hurts anyone ever again. And then they find they’re the ones who need protecting. It’s a classic made-for-TV horror movie with a fun cast, some impressive direction and camerawork, and just an overall good time.

Paper Moon (1973; rewatch) — Moses “Moze” Pray (Ryan O’Neal) is a con man who travels from town to town looking for suckers. He attends the funeral of a woman he once knew and gets roped into driving the deceased woman’s daughter, Addie (Tatum O’Neal), to some relatives the next state over. Along the way, Addie gets hooked on scamming people and proves that she’s not one to be bullied or underestimated. It’s an utterly charming film that just sucks you in and won’t relent any more than Addie will.